-- Logs begin at Mon 2022-07-04 08:33:31 UTC, end at Mon 2022-07-04 09:36:27 UTC. -- Jul 04 09:06:09.035462 dv-cinder-819149-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 09:06:09.049599 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 09:06:09 2022] *** Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: nodename: dv-cinder-819149-7-iscsi Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: machine: x86_64 Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: clock source: unix Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: pcre jit disabled Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: detected number of CPU cores: 4 Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: current working directory: / Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: detected binary path: /usr/bin/uwsgi-core Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: your processes number limit is 47680 Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: your memory page size is 4096 bytes Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: detected max file descriptor number: 2048 Jul 04 09:06:09.051804 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: lock engine: pthread robust mutexes Jul 04 09:06:09.053109 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: thunder lock: enabled Jul 04 09:06:09.053109 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 09:06:09.053109 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 09:06:09.097833 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: Python main interpreter initialized at 0x559b6da559c0 Jul 04 09:06:09.097833 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: python threads support enabled Jul 04 09:06:09.097833 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: your server socket listen backlog is limited to 100 connections Jul 04 09:06:09.097833 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: your mercy for graceful operations on workers is 90 seconds Jul 04 09:06:09.098302 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 09:06:09.098302 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: *** Operational MODE: preforking *** Jul 04 09:06:09.098546 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: *** uWSGI is running in multiple interpreter mode *** Jul 04 09:06:09.098546 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: spawned uWSGI master process (pid: 103252) Jul 04 09:06:09.098697 dv-cinder-819149-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 09:06:09.101859 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: spawned uWSGI worker 1 (pid: 103264, cores: 1) Jul 04 09:06:09.101859 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: spawned uWSGI worker 2 (pid: 103266, cores: 1) Jul 04 09:06:09.101859 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 09:06:09.759843 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:06:09.766322 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:06:10.875357 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:06:10.875357 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes Jul 04 09:06:10.876126 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:06:10.876126 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes Jul 04 09:06:10.880730 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:06:10.880730 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: from cryptography.utils import int_from_bytes Jul 04 09:06:10.881200 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:06:10.881200 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: from cryptography.utils import int_from_bytes Jul 04 09:06:13.303646 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:06:13.304205 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:06:13.304303 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:06:13.304646 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:06:13.304717 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:06:13.304788 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:06:13.304935 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:06:13.305084 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:06:13.305291 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:06:13.305423 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.305517 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:06:13.305651 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.305918 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.306067 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.306241 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.306336 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.306583 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.306731 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.306867 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.306970 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.307225 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.307358 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.307541 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.307680 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.307870 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.308012 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.308101 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.308188 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.308424 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.308566 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.308749 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-7-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.308881 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.309064 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.309213 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.309349 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.309444 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-7-iscsi {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.309678 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.309820 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.309996 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.310100 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.310293 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.310438 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.310593 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.310685 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.310891 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.311041 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.311211 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.311391 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.311503 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.311826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.311999 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.312123 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.312285 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.312399 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.312582 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.312749 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.312891 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.313058 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.313194 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.313370 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.313496 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.313686 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.313783 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.314065 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.314189 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.314328 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.314453 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.314641 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.314734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.314997 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.315094 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-7-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.315352 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.315496 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-7-iscsi {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.315661 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.315792 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.315961 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.316099 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.316369 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.316501 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.316674 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.316801 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.316968 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.317111 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.317289 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.317414 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.317610 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.317800 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.318024 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.318152 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.318353 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.318451 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.318675 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.318775 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.318993 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.319093 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.319315 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.319409 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.319619 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.319704 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.319929 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.320014 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.320234 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.320326 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.320534 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.320618 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.320835 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.320928 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.321137 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.321222 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.321383 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.321467 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.321663 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.321747 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.321992 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.322081 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.322312 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.322405 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.322629 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.322714 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.322879 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.322960 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.323108 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.323196 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.323408 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.323504 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.323721 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.323811 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.324025 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.324109 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.324328 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.324421 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.324629 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.324721 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.324926 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.325010 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.325227 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.325312 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.325525 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.325609 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.325828 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.325943 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.326154 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.326240 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.326456 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.326542 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.326769 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.326854 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.327077 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.327162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.327379 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.327464 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.327681 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.327764 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.327996 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.328082 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.328308 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.328398 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.328613 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.328715 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.328914 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.328997 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.329248 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.329339 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.329555 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.329651 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.329857 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.329989 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.330192 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.330276 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.330497 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.330593 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.330802 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.330893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.331106 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.331190 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.331404 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.331502 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.331722 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.331827 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332032 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332116 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332280 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332373 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332570 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332661 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332866 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.332958 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.333168 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.333254 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.333505 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.333588 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.333808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.333914 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.334135 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.334224 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.334433 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.334523 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.334725 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.334817 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.335026 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.335112 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.335327 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.335420 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.335629 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.335726 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.335931 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.336022 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.336228 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.336319 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.336528 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.336622 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.336828 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.336947 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.337130 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.337213 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.337429 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.337522 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.337744 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.337835 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.338073 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.338158 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.338376 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.338478 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.338677 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.338803 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.338978 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.339116 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.339278 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.339376 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.339582 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.339674 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.339881 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.339966 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.340181 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.340275 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.340487 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.340570 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.340791 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.340883 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.341087 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.341183 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.341397 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.341482 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.341694 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.341778 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.342016 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.342122 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.342317 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.342402 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.342616 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.342708 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.342916 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.343002 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.343219 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.343303 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.343517 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.343608 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.343816 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.343901 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.344110 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.344193 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.344407 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.344491 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.344703 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.344799 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345003 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345089 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345303 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345394 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345598 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345734 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345902 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.345990 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.346218 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.346314 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.346521 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.346614 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.346823 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.346907 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.347128 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.347222 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.347446 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.347566 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.347779 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.347865 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:06:13.348108 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.348202 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.348448 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.348541 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.348763 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.348881 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.349148 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.349308 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.349478 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.349577 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.349804 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.349921 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.350145 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.350242 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.350454 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.350540 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.350768 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.350853 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.351095 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.351182 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.351405 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.351489 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.351714 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.351798 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.352023 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.352110 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.352338 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.352425 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.352651 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.352746 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.352966 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.353051 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.353278 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.353361 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.353589 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.353673 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.353912 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.354000 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.354219 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.354306 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.354533 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.354621 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.354856 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.354941 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.355166 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.355253 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.355471 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.355564 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.355810 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.355903 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.356136 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.356220 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.356442 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.356535 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.356762 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.356846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.357073 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.357158 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.357379 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.357473 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.357685 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.357772 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.358010 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.358099 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.358332 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.358429 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.358645 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.358728 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.358950 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.359033 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.359262 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.359347 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.359567 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.359665 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.359873 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.359957 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.360176 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.360261 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.360483 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.360568 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.360793 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.360885 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.361117 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.361202 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.361425 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.361513 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.361731 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.361831 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.362060 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.362148 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.362373 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.362457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.362677 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.362770 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.362982 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.363065 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.363285 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.363369 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.363584 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.363681 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.363882 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.364002 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.364180 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.364272 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.364478 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.364572 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.364830 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.364962 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.365147 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.365294 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.365468 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.365604 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.365768 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.365961 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.366119 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.366268 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.366422 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.366582 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.366730 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.366894 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.367038 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.367208 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.367348 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.367516 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.367648 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.367830 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.367957 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.368141 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.368265 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.368446 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.368565 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.368774 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.368883 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.369085 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.369179 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.369390 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.369482 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.369713 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.369799 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.370043 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.370150 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.370348 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.370436 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.370660 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.370744 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.370974 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.371061 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.371285 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.371371 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.371595 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.371679 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.371904 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.371992 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.372226 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.372319 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.372536 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.372621 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.372839 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.372925 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.373167 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.373259 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.373491 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.373585 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.373789 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.373901 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.374133 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.374218 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.374452 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.374550 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.374762 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.374849 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.375059 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.375152 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.375365 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.375464 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.375662 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.375747 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.375960 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.376044 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.376258 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.376351 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.376562 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.376654 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.376859 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.376944 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.377156 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.377258 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.377454 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.377545 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.377750 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.377834 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.378071 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.378160 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.378390 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.378474 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.378690 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.378775 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.378989 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.379081 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.379284 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.379371 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.379581 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.379665 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.379918 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.380018 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.380243 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.380439 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.380577 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.380671 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.380945 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.381042 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.381213 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.381298 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.381528 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.381623 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.381834 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.381946 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.382163 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.382257 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.382470 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.382564 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.382771 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.382855 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.383074 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.383167 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.383377 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.383471 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.383689 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.383774 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.384303 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.384403 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.384613 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.384713 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.384918 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.385003 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.385233 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.385325 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.385536 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.385622 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.385849 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.385953 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.386175 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.386258 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.386482 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.386569 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.386812 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.386904 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.387133 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.387217 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.387442 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.387529 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.387757 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.387842 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.388058 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.388142 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.388365 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.388452 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.388668 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.388760 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.388971 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.389065 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.389272 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.389358 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.389573 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.389657 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.389924 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.390028 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.390214 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.390308 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.390523 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.390620 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.390826 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.390920 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.391141 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.391227 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.391441 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.391535 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.391753 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.391846 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.392046 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.392131 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.392353 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.392436 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.392670 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.392763 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.392995 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.393081 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.393298 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.393383 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.393603 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.393689 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.393939 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.394067 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.394247 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.394358 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.394551 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.394662 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.394879 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.395006 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.395152 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.395454 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.395758 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.396225 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.396435 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.396522 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.396600 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.396845 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.396941 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.397155 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.397240 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.397465 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.397548 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.397771 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.397856 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.398095 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.398198 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.398401 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.398486 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.398709 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.398795 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.399014 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.399097 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.399318 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.399404 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.399630 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.399760 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.399944 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.400028 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.400250 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.400334 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.400552 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.400645 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.400869 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.400963 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.401171 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.401327 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.401469 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.401562 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.401771 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.401856 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.402094 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.402191 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.402402 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.402486 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.402708 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.402793 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.403012 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.403107 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.403324 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.403408 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.403639 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.403724 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.403939 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.404038 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.404293 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.404387 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.404552 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.404639 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.404857 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.404967 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.405171 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.405302 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.405476 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.405562 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.405782 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.405876 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.406114 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.406199 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.406421 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.406506 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.406728 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.406821 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.407032 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.407117 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.407338 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.407421 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.407644 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.407733 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.407956 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.408090 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.408258 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.408368 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.408555 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.408652 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.408861 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.408974 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.409167 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.409271 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.409470 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.409783 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.409982 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.410104 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.410321 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.410636 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.410734 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.410952 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.411038 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.411270 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.411364 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.411623 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.411715 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.411940 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.412091 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.412260 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.412421 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.412591 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.412762 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.412921 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.413070 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.413269 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.413363 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.413576 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.413664 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.413901 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.413991 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.414216 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.414302 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.414522 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.414608 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.414833 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.414921 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.415136 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.415277 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.415440 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.415524 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.415735 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.415821 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.416035 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.416120 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.416336 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.416427 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.416641 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.416761 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.416943 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.417030 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.417248 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.417341 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.417560 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.417651 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.417857 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.418007 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.418190 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.418283 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.418495 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.418587 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.418794 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.418891 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.419098 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.419217 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.419395 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.419492 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.419697 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.419795 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.419999 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.420095 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.420342 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.420438 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.420645 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.420753 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.420979 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.421080 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.421278 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.421372 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.421579 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.421675 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.421905 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.422003 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.422214 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.422314 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.422514 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.422609 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.422811 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.422900 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.423114 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.423204 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.423413 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.423512 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.423707 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.423805 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.424009 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.424096 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.424308 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.424403 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.424610 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.424709 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.424915 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.425006 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.425211 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.425394 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.425519 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.425624 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.425817 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.425918 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.426149 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.426238 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.426453 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.426545 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.426749 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.426833 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.427152 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.427250 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.427429 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.427666 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.427761 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.428030 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.428124 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.428337 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.428423 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.428641 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.428735 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.428949 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.429043 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.429249 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.429335 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.429563 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.429655 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.429865 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.430055 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.430187 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.430271 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.430488 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.430582 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.430789 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.430875 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.431086 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.431172 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.431389 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.431472 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.431693 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.431779 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.431991 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.432076 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.432288 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.432374 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.432589 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.432674 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.432884 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.432968 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.433181 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.433279 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.433480 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.433565 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.433788 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.433872 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.434124 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.434226 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.434426 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.434519 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.434731 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.434823 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.435030 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.435124 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.435329 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.435414 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.435627 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.435712 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.435926 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.436024 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.436221 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.436305 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.436519 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.436606 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.436816 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.436901 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.437113 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.437197 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.437411 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.437497 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.437709 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.437801 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.438051 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.438139 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.438353 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.438449 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.438652 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.438737 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.438949 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.439041 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.439248 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.439332 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.439572 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.439658 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.439874 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.440001 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.440219 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.440316 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.440517 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.440601 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.440830 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.440922 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.441139 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.441237 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.441445 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.441530 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.441752 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.441844 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.442074 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.442177 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.442385 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.442469 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.442707 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.442793 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.443016 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.443124 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.443316 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.443406 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.443614 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.443698 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.443915 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.444010 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.444222 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.444307 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.444528 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.444613 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.444838 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.444961 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.445151 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.445236 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.445470 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.445555 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.445769 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.445927 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.446096 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.446181 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.446401 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.446499 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.446712 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.446798 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.447017 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.447112 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.447325 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.447417 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.447633 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.447729 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.447943 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.448034 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.448253 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.448347 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.448565 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.448649 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.448875 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.448959 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.449173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.449267 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.449477 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.449560 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.449778 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.449862 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.450103 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.450230 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.450404 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.450488 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.450722 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.450814 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.451026 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.451119 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.451325 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.451408 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.451624 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.451707 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.451925 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.452009 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.452224 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.452309 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.452526 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.452649 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.452951 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.453038 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.453258 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.453342 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.453561 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.453647 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.453862 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.454013 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.454190 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.454274 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.454497 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.454580 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.454808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.454895 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.455107 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.455202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.455406 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.455518 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.455822 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.455908 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.456126 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.456210 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.456432 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.456530 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.456730 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.456816 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.457029 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.457113 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.457326 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.457417 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.457632 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.457717 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.457963 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.458062 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.458267 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.458424 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.458642 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.458744 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.458958 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.459046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.459258 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.459353 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.459581 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.459667 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.459917 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.460001 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.460295 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.460388 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.460597 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.460690 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.460923 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.461008 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.461293 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.461424 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.461598 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.461684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.461938 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.462027 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.462254 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.462342 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.462572 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.462660 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.462869 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.462964 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.463175 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.463271 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.463481 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.463575 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.463786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.463877 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.464103 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.464262 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.464409 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.464495 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.464716 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.464810 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.465014 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.465109 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.465318 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.465403 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.465633 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.465718 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.465970 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.466115 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.466283 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.466368 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.466602 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.466688 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.466989 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.467083 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.467298 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.467384 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.467613 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.467698 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.467931 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.468024 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.468228 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.468320 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.468529 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.468615 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.468834 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.468919 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.469130 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.469214 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.469429 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.469516 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.469733 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.469818 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.470054 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.470141 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.470367 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.470457 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.470670 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.470758 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.470973 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.471057 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.471267 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.471361 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.471565 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.471654 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.471865 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.471949 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.472166 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.472261 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.472479 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.472571 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.472782 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.472869 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.473095 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.473188 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.473408 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.473493 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.473707 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.473793 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.474083 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.474200 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.474386 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.474474 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.474686 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.474781 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.474984 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.475071 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.475281 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.475374 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.475616 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.475702 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.475915 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.476003 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.476230 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.476317 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.476556 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.476642 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.476879 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.476968 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.477186 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.477279 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.477498 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.477582 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.477819 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.477952 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.478152 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.478238 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.478464 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.478565 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.478780 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.478866 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.479078 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.479166 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.479378 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.479471 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.479676 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.479761 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.479972 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.480057 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.480270 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.480407 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.480565 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.480652 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.480862 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.480955 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.481157 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.481251 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.481453 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.481578 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.481746 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.481831 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.482071 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.482159 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.482369 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.482453 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.482678 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.482762 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.482980 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.483066 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.483276 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.483370 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.483574 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.483665 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.483869 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.483956 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.484167 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.484252 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.484487 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.484573 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.484791 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.484885 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.485110 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.485194 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.485425 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.485523 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.485740 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.485825 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.486067 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.486155 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.486425 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.486525 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.486753 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.486839 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.487060 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.487146 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.487371 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.487465 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.487678 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.487771 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.487987 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.488136 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.488294 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.488392 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.488603 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.488690 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.488907 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.489001 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.489213 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.489299 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.489518 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.489662 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.489873 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.490114 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.490348 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.490469 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.490719 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.490870 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.491032 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.491201 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.491341 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.491518 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.491648 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.491834 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.491959 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.492147 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.492268 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.492460 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.492575 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.492774 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.492882 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.493085 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.493173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.493394 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.493481 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.493704 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.493797 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.494039 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.494128 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.494367 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.494454 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.494689 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.494775 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.495015 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.495101 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.495343 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.495427 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.495654 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.495750 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.495964 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.496056 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.496276 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.496403 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.496588 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.496675 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.496894 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.496979 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.497204 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.497290 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.497516 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.497611 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.497825 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.497941 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.498159 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.498246 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.498467 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.498555 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.498775 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.498858 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.499083 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.499176 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.499390 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.499476 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.499695 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.499780 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.500003 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.500100 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.500312 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.500397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.500623 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.500749 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.500933 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.501034 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.501254 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.501339 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.501563 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.501647 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.501872 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.502017 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.502203 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.502290 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.502513 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.502716 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.502811 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.503031 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.503328 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.503423 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.503646 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.503738 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.503972 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.504058 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.504287 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.504372 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.504602 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.504688 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.504913 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.505004 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.505253 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.505348 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.505585 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.505680 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.505903 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.505992 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.506217 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.506304 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.506517 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.506610 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.506826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.506911 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.507129 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.507215 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.507427 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.507527 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.507742 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.507828 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.508042 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.508126 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.508362 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.508565 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.508673 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.509216 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.509506 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.509593 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.509840 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.509944 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.510182 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.510272 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.510492 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.510576 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.510795 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.510888 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.511116 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.511212 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.511420 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.511505 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.511719 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.511805 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.512029 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.512149 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.512331 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.512415 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.512627 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.512713 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.512927 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.513012 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.513228 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.513320 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.513532 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.513617 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.513829 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.513972 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.514161 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.514254 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.514459 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.514543 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.514767 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.514854 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.515069 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.515163 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.515371 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.515457 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.515673 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.515759 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.515976 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.516069 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.516272 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.516358 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.516571 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.516656 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.516871 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.516963 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.517168 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.517260 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.517468 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.517559 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.517772 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.517866 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.518107 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.518192 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.518408 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.518493 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.518714 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.518802 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.519017 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.519104 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.519326 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.519411 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.519628 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.519715 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.519933 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.520019 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.520273 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.520367 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.520573 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.520659 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.520931 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.521024 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.521236 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.521330 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.521547 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.521632 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.521853 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.522009 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.522183 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.522346 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.522495 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.522580 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.522803 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.522897 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.523149 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.523335 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.523465 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.523662 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.523979 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.524064 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.524309 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.524403 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.524625 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.524709 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.524927 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.525014 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.525229 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.525323 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.525527 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.525613 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.525846 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.525952 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.526179 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.526275 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.526489 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.526576 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.526797 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.526897 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.527103 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.527189 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.527409 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.527503 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.527717 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.527816 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.528021 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.528107 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.528325 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.528417 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.528630 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.528727 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.528935 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.529022 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.529242 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.529328 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.529544 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.529636 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.529848 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.529979 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.530178 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.530263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.530484 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.530570 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.530800 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.530886 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.531122 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.531213 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.531436 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.531530 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.531751 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.531841 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.532055 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.532146 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.532359 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.532455 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.532665 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.532750 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.532967 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.533067 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.533273 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.533363 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.533580 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.533666 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.533907 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.534011 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.534212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.534298 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.534536 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.534620 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.534840 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.534975 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.535222 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.535308 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.535540 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.535628 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.535847 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.535935 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.536164 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.536255 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.536498 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.536586 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.536803 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.536890 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.537122 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.537298 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.537428 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.537611 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.537753 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.537957 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.538126 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.538270 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.538451 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.538600 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.538770 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.538939 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.539072 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.539267 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.539372 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.539591 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.539678 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.539896 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.539982 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.540200 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.540286 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.540503 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.540589 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.540811 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.540898 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.541127 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.541220 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.541430 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.541515 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.541729 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.541814 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.542052 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.542149 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.542350 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.542435 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.542647 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.542741 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.542949 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.543050 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.543243 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.543327 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.543542 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.543625 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.543836 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.543931 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.544133 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.544217 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.544427 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.544511 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.544722 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.544807 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.545023 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.545114 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.545318 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.545403 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.545618 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.545713 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.545932 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.546021 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.546230 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.546316 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.546531 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.546618 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.546827 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.546953 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.547127 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.547220 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.547428 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.547522 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.547756 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.547841 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.548059 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.548165 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.548374 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.548459 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.548677 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.548762 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.548986 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.549078 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.549299 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.549384 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.549604 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.549688 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.549931 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.550032 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.550256 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.550342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.550559 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.550644 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.550868 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.551035 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.551173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.551293 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.551479 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.551566 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.551785 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.551880 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.552132 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.552227 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.552459 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.552633 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.552783 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.553087 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.553200 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.553408 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.553560 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.553721 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.553901 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.554061 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.554246 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.554376 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.554556 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.554684 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.554882 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.555008 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.555204 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.555316 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.555525 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.555621 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.555842 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.555928 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.556161 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.556247 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.556492 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.556592 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.556802 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.556887 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.557110 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.557197 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.557425 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.557511 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.557735 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.557821 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.558062 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.558149 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.558380 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.558466 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.558698 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.558785 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.559025 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.559114 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.559336 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.559429 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.559648 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.559733 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.559973 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.560057 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.560289 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.560375 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.560599 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.560684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.560901 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.560996 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.561140 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:06:13.561261 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.561586 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.561937 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.562232 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.562534 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:06:13.562775 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:06:13.625758 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Registered counter for database nova_api Jul 04 09:06:13.626017 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Registered counter for database nova_api Jul 04 09:06:13.739951 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:13.742051 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:13.746642 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:13.749686 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:13.803533 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.context [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4410294-294c-406b-9aa4-054e5a299f2c(cell1) {{(pid=103264) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:06:13.807769 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:06:13.809523 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:06:13.810344 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:06:13.812507 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:06:13.814578 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Registered counter for database nova_cell0 Jul 04 09:06:13.816517 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.context [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4410294-294c-406b-9aa4-054e5a299f2c(cell1) {{(pid=103266) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:06:13.818577 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Registered counter for database nova_cell1 Jul 04 09:06:13.821419 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:06:13.823149 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:06:13.823828 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:06:13.827589 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:06:13.827824 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:13.828393 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Registered counter for database nova_cell0 Jul 04 09:06:13.828532 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:13.832583 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Registered counter for database nova_cell1 Jul 04 09:06:13.834285 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:13.837097 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:13.841693 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:13.846418 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:13.847071 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:13.989297 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Registered counter for database nova_cell0 Jul 04 09:06:13.998811 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:14.003218 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:14.003914 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:14.013153 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Registered counter for database nova_cell0 Jul 04 09:06:14.022533 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:06:14.027764 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:06:14.347269 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:06:14.355136 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:06:14.355292 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:06:14.362561 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:06:14.698352 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:06:14.703653 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:06:14.704240 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:06:14.709796 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-b2c460ff-9ca4-43b7-b5be-23b73d944c89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:06:14.709978 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559b6da559c0 pid: 103266 (default app) Jul 04 09:06:14.712013 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:06:14.713228 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001800 Jul 04 09:06:14.713638 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon Jul 4 09:06:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:06:14.715066 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559b6da559c0 pid: 103264 (default app) Jul 04 09:07:30.165506 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:30.167111 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Jul 04 09:07:30.168598 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:30.180691 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:30.182217 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell0:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:30.183431 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell1:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:30.184381 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:30.637825 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-270b08ef-f35e-47b7-a475-c615f1955f89 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:30.668958 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-270b08ef-f35e-47b7-a475-c615f1955f89 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.494316 Jul 04 09:07:30.669794 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 4 09:07:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:32.716864 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:32.717934 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-81da256d-0c4f-4c71-8cd2-d9533791a698 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 04 09:07:32.718521 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:32.781409 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-6331cae8-cfbb-4a7d-8890-1d62c5902958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:32.800115 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:07:32.800115 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: warnings.warn(msg) Jul 04 09:07:32.834407 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-6331cae8-cfbb-4a7d-8890-1d62c5902958 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109789 Jul 04 09:07:32.835530 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:07:32.850581 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:32.851931 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:32.853292 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell1:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:32.854493 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:07:33.057513 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-64338854-abb7-47bb-9bb7-bb7c02c29916 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:33.059866 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:07:33.059866 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 04 09:07:33.123552 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-64338854-abb7-47bb-9bb7-bb7c02c29916 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279496 Jul 04 09:07:33.135167 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 4 09:07:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:35.219598 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-6331cae8-cfbb-4a7d-8890-1d62c5902958 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:35.220606 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-6331cae8-cfbb-4a7d-8890-1d62c5902958 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 04 09:07:35.220972 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:35.327416 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-5bcb36ae-1e81-4742-b3bf-20b6010e8e0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:35.344890 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:07:35.344890 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 04 09:07:35.365171 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-5bcb36ae-1e81-4742-b3bf-20b6010e8e0f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138140 Jul 04 09:07:35.365752 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:35.378613 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-d60c867b-7c8c-4ed2-949a-98a6852dad7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:35.380099 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:07:35.380099 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: warnings.warn(msg) Jul 04 09:07:35.413447 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-d60c867b-7c8c-4ed2-949a-98a6852dad7f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038708 Jul 04 09:07:35.414258 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 4 09:07:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:37.472116 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-5bcb36ae-1e81-4742-b3bf-20b6010e8e0f admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:37.473131 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-5bcb36ae-1e81-4742-b3bf-20b6010e8e0f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 04 09:07:37.473502 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:37.534927 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-393c1c64-df59-4a64-95cd-af41f9692866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:37.554542 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-393c1c64-df59-4a64-95cd-af41f9692866 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074692 Jul 04 09:07:37.555273 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:37.566814 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-0c49f29d-d5ff-4b0d-a110-fb8d0e9ddc2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:37.589708 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-0c49f29d-d5ff-4b0d-a110-fb8d0e9ddc2c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026535 Jul 04 09:07:37.590317 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 4 09:07:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:39.661480 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-393c1c64-df59-4a64-95cd-af41f9692866 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:39.662452 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-393c1c64-df59-4a64-95cd-af41f9692866 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 04 09:07:39.662846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:39.727321 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-5e9e0534-81aa-4d76-8929-3de5368fbf11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "swap": 0, "id": "d3", "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:39.747622 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-5e9e0534-81aa-4d76-8929-3de5368fbf11 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078641 Jul 04 09:07:39.748139 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:39.760272 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-bafb8a0e-fcad-4cac-be0a-83cfa82b991a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:39.784677 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-bafb8a0e-fcad-4cac-be0a-83cfa82b991a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028242 Jul 04 09:07:39.785246 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 4 09:07:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:41.854528 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-5e9e0534-81aa-4d76-8929-3de5368fbf11 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:41.856055 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-5e9e0534-81aa-4d76-8929-3de5368fbf11 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Jul 04 09:07:41.856712 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:41.914618 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-9ae4102a-c154-40b4-a4ae-9b51bcc7afc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:41.933842 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-9ae4102a-c154-40b4-a4ae-9b51bcc7afc9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071305 Jul 04 09:07:41.934418 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:41.946394 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-707fec62-575b-4a8c-8090-0763fa7a2cbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:41.969536 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-707fec62-575b-4a8c-8090-0763fa7a2cbe admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026918 Jul 04 09:07:41.970202 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 4 09:07:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:44.027374 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-9ae4102a-c154-40b4-a4ae-9b51bcc7afc9 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:44.028774 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-9ae4102a-c154-40b4-a4ae-9b51bcc7afc9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001825 Jul 04 09:07:44.029495 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:44.094826 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-692ff389-06f9-4fee-97a7-3a39496605ae admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:44.119168 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-692ff389-06f9-4fee-97a7-3a39496605ae admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083654 Jul 04 09:07:44.119993 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 4 09:07:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:07:46.215228 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-9ae4102a-c154-40b4-a4ae-9b51bcc7afc9 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:46.216225 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-9ae4102a-c154-40b4-a4ae-9b51bcc7afc9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 04 09:07:46.216631 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:46.280113 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-6041d2d6-dd2c-46ea-bfa8-8608fbd3885d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:46.299793 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-6041d2d6-dd2c-46ea-bfa8-8608fbd3885d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077188 Jul 04 09:07:46.301030 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:07:46.312537 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-527f84bc-6d8b-404e-a096-2fc356578dd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:46.337164 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-527f84bc-6d8b-404e-a096-2fc356578dd9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028428 Jul 04 09:07:46.337747 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 4 09:07:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:07:48.486417 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-6041d2d6-dd2c-46ea-bfa8-8608fbd3885d admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:48.487732 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-6041d2d6-dd2c-46ea-bfa8-8608fbd3885d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Jul 04 09:07:48.488304 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:48.552501 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b90c4d16-9db9-47ac-bbfe-2fd77361b9ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "disk": 20, "id": "2", "swap": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:48.571856 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b90c4d16-9db9-47ac-bbfe-2fd77361b9ca admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075970 Jul 04 09:07:48.572418 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:48.586511 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-53df6206-03ec-48b6-bb89-c6b45072dcf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:48.611265 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-53df6206-03ec-48b6-bb89-c6b45072dcf3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028555 Jul 04 09:07:48.611863 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 4 09:07:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:50.717660 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b90c4d16-9db9-47ac-bbfe-2fd77361b9ca admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:50.719153 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b90c4d16-9db9-47ac-bbfe-2fd77361b9ca admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Jul 04 09:07:50.719762 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:50.781164 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-04628a3b-1b69-4e89-b811-d66383c35736 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "swap": 0}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:50.800545 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-04628a3b-1b69-4e89-b811-d66383c35736 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074429 Jul 04 09:07:50.801184 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:50.814899 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8751f73b-c3ec-4568-b4fc-a1d577a4d572 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:50.844683 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-8751f73b-c3ec-4568-b4fc-a1d577a4d572 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034412 Jul 04 09:07:50.845408 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 4 09:07:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:53.139058 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-04628a3b-1b69-4e89-b811-d66383c35736 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:53.140082 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-04628a3b-1b69-4e89-b811-d66383c35736 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001829 Jul 04 09:07:53.140488 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:07:53.200863 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-d6948b19-b69e-4562-993e-863268105947 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "swap": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:53.221497 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-d6948b19-b69e-4562-993e-863268105947 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075094 Jul 04 09:07:53.222264 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:07:53.234433 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-caa7cc2e-fd06-4aef-8951-af327dfec903 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:53.259348 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-caa7cc2e-fd06-4aef-8951-af327dfec903 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028733 Jul 04 09:07:53.259917 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 4 09:07:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:07:55.349721 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-d6948b19-b69e-4562-993e-863268105947 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:07:55.350881 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-d6948b19-b69e-4562-993e-863268105947 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 04 09:07:55.351332 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:07:55.414206 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b15b162a-453d-4eba-9a64-df4ef6859eb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:55.433628 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b15b162a-453d-4eba-9a64-df4ef6859eb6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076195 Jul 04 09:07:55.434397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 4 09:07:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:07:55.446458 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8a77da15-80fc-4c9d-90f8-790465ea0fcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:07:55.471983 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-8a77da15-80fc-4c9d-90f8-790465ea0fcc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029369 Jul 04 09:07:55.472573 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 4 09:07:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:08:20.031510 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b15b162a-453d-4eba-9a64-df4ef6859eb6 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:20.032824 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b15b162a-453d-4eba-9a64-df4ef6859eb6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001963 Jul 04 09:08:20.033361 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:20.045673 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:20.095024 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-6446667c-c7ce-4937-b9f6-6fc862cbc144 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:20.112739 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-6446667c-c7ce-4937-b9f6-6fc862cbc144 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071809 Jul 04 09:08:20.113286 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 4 09:08:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:08:21.028319 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b15b162a-453d-4eba-9a64-df4ef6859eb6 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:21.029332 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b15b162a-453d-4eba-9a64-df4ef6859eb6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 04 09:08:21.029785 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:21.241947 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-37b8d9d4-3a08-42b5-ab1d-832806737474 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:21.249753 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-37b8d9d4-3a08-42b5-ab1d-832806737474 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-37b8d9d4-3a08-42b5-ab1d-832806737474 admin admin] Request method failure captured: Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Accept: application/json Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Host: 10.222.0.26 Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABiwq4FxBGtERbLubQFKVQ3vTbQTFjX-Z_Cp1efq8-OVUjciUE8WwK-JoqD8nWA4Kc491OKPC0ZJk4cz7Kb_5nxsmXOhcEhw3JhcIlbcsu5cowOHMexekJBKewWHZvnrYcyNPBrKDHL-4xqCAlj1kPZz_LCuM9rL5oByJNVvd5fHiUBH2k Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Role: admin,member,reader Jul 04 09:08:21.254263 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Roles: admin,member,reader Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f0a53c420a84618ab851430c484608a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f0a53c420a84618ab851430c484608a"}]}] Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User: admin Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Id: 78c2f3799fc8459a9a6e05f14a552498 Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: method: > Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: exception: Flavor 42 could not be found. Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: action_args: {'id': '42'} Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:08:21.255893 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:21.256786 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.258046 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-37b8d9d4-3a08-42b5-ab1d-832806737474 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:08:21.259110 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-37b8d9d4-3a08-42b5-ab1d-832806737474 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.083304 Jul 04 09:08:21.259110 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 4 09:08:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:08:21.266130 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d246c6c2-0053-48a2-94fa-18014a1a6598 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:21.269179 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:08:21.288484 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d246c6c2-0053-48a2-94fa-18014a1a6598 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026369 Jul 04 09:08:21.289023 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 4 09:08:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:08:21.298833 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-60a576c4-c27d-4a5b-b0f9-615b4b6c7d9c admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:21.320896 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-60a576c4-c27d-4a5b-b0f9-615b4b6c7d9c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025663 Jul 04 09:08:21.321439 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 4 09:08:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:08:21.331026 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-0d5be06b-2075-4b3c-bc61-6f264af9feaa admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:21.337491 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-0d5be06b-2075-4b3c-bc61-6f264af9feaa admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-0d5be06b-2075-4b3c-bc61-6f264af9feaa admin admin] Request method failure captured: Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Host: 10.222.0.26 Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABiwq4FxBGtERbLubQFKVQ3vTbQTFjX-Z_Cp1efq8-OVUjciUE8WwK-JoqD8nWA4Kc491OKPC0ZJk4cz7Kb_5nxsmXOhcEhw3JhcIlbcsu5cowOHMexekJBKewWHZvnrYcyNPBrKDHL-4xqCAlj1kPZz_LCuM9rL5oByJNVvd5fHiUBH2k Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Role: admin,member,reader Jul 04 09:08:21.340790 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Roles: admin,member,reader Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f0a53c420a84618ab851430c484608a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f0a53c420a84618ab851430c484608a"}]}] Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User: admin Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Id: 78c2f3799fc8459a9a6e05f14a552498 Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: method: > Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: exception: Flavor 42 could not be found. Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: action_args: {'id': '42'} Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:08:21.342397 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:21.343457 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:21.344734 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-0d5be06b-2075-4b3c-bc61-6f264af9feaa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:08:21.346021 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-0d5be06b-2075-4b3c-bc61-6f264af9feaa admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014711 Jul 04 09:08:21.346021 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 4 09:08:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:08:22.163159 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-60a576c4-c27d-4a5b-b0f9-615b4b6c7d9c admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:22.164216 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-60a576c4-c27d-4a5b-b0f9-615b4b6c7d9c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 04 09:08:22.164617 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:22.367993 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-efa864a2-87be-4343-8b63-7cfd9b7abdae admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:22.374256 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-efa864a2-87be-4343-8b63-7cfd9b7abdae admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-efa864a2-87be-4343-8b63-7cfd9b7abdae admin admin] Request method failure captured: Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Host: 10.222.0.26 Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABiwq4G6vH7U47shWGes5MqWs-4tTe-wwh3ZR7Dp70ma9ml7DZOXEmTNfVHSzhF_UZpY5Fnuzd60sx2iahtoPp7hBIZ9OgxBjmJ8JX81nl51uexkQZn8H1IIdcd4m3U3tLXxZznluu0qJc90PBqOA--ERlXM9Z9qb0hJSN3u46KRah2PDU Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Role: admin,member,reader Jul 04 09:08:22.375741 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Roles: admin,member,reader Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f0a53c420a84618ab851430c484608a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f0a53c420a84618ab851430c484608a"}]}] Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User: admin Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Id: 78c2f3799fc8459a9a6e05f14a552498 Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: method: > Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: exception: Flavor 84 could not be found. Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: action_args: {'id': '84'} Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:08:22.377173 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:22.378123 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.379172 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-efa864a2-87be-4343-8b63-7cfd9b7abdae admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:08:22.380236 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-efa864a2-87be-4343-8b63-7cfd9b7abdae admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068725 Jul 04 09:08:22.380236 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 4 09:08:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:08:22.388053 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fcac934d-b2aa-4aca-ae15-f7de94ad4289 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:22.402053 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fcac934d-b2aa-4aca-ae15-f7de94ad4289 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017963 Jul 04 09:08:22.402571 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 4 09:08:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:08:22.412264 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-1bb97b6d-91ca-4de6-9155-1398eed1b4e5 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:22.425862 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-1bb97b6d-91ca-4de6-9155-1398eed1b4e5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017319 Jul 04 09:08:22.426404 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 4 09:08:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:08:22.437830 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-53df9f8a-98a9-4a01-bf63-8d1eee14b627 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:22.444154 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-53df9f8a-98a9-4a01-bf63-8d1eee14b627 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-53df9f8a-98a9-4a01-bf63-8d1eee14b627 admin admin] Request method failure captured: Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Accept: application/json Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Host: 10.222.0.26 Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABiwq4G6vH7U47shWGes5MqWs-4tTe-wwh3ZR7Dp70ma9ml7DZOXEmTNfVHSzhF_UZpY5Fnuzd60sx2iahtoPp7hBIZ9OgxBjmJ8JX81nl51uexkQZn8H1IIdcd4m3U3tLXxZznluu0qJc90PBqOA--ERlXM9Z9qb0hJSN3u46KRah2PDU Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Role: admin,member,reader Jul 04 09:08:22.445684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Roles: admin,member,reader Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f0a53c420a84618ab851430c484608a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f0a53c420a84618ab851430c484608a"}]}] Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User: admin Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Id: 78c2f3799fc8459a9a6e05f14a552498 Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: method: > Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: exception: Flavor 84 could not be found. Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: action_args: {'id': '84'} Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:08:22.447188 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:22.448078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:22.449321 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-53df9f8a-98a9-4a01-bf63-8d1eee14b627 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:08:22.450575 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-53df9f8a-98a9-4a01-bf63-8d1eee14b627 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012945 Jul 04 09:08:22.450575 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 4 09:08:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:08:23.260503 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-1bb97b6d-91ca-4de6-9155-1398eed1b4e5 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:23.261497 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-1bb97b6d-91ca-4de6-9155-1398eed1b4e5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 04 09:08:23.262269 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:23.459205 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-34b3a8d0-2288-48a2-aaa7-ff3012703b20 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:23.465638 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-34b3a8d0-2288-48a2-aaa7-ff3012703b20 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-34b3a8d0-2288-48a2-aaa7-ff3012703b20 admin admin] Request method failure captured: Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Accept: application/json Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Host: 10.222.0.26 Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABiwq4HLUZjwc4xRi5IEQ2EqWLAm9zloN3UzipEivJBovdBEWfPPdVntuBLxs7Rfq_wysX0aYpKZM76bpNBcwNymNQl5Wrm-Dcrn7GlKz3xJwrYimPb5QWT8RQ331MCd33WkRgMRt8Afjde1MIYKv-iPnJYsFE0Y4NfGLTM3eukBJWD_tY Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Role: admin,member,reader Jul 04 09:08:23.467202 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Roles: admin,member,reader Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f0a53c420a84618ab851430c484608a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f0a53c420a84618ab851430c484608a"}]}] Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User: admin Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Id: 78c2f3799fc8459a9a6e05f14a552498 Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: method: > Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: exception: Flavor 451 could not be found. Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: action_args: {'id': '451'} Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:08:23.468846 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:23.469826 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.471162 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-34b3a8d0-2288-48a2-aaa7-ff3012703b20 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:08:23.472594 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-34b3a8d0-2288-48a2-aaa7-ff3012703b20 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069218 Jul 04 09:08:23.472594 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 4 09:08:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:08:23.478746 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-2160f4dc-bd9e-42fb-ba0c-75c80d4f8641 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:23.493416 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-2160f4dc-bd9e-42fb-ba0c-75c80d4f8641 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018343 Jul 04 09:08:23.494128 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 4 09:08:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:08:23.503183 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:23.519195 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019525 Jul 04 09:08:23.519718 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 4 09:08:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:08:23.529398 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-ca7397f0-2ffa-4f64-9e88-66ab21efa87c admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:23.535177 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-ca7397f0-2ffa-4f64-9e88-66ab21efa87c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-ca7397f0-2ffa-4f64-9e88-66ab21efa87c admin admin] Request method failure captured: Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Host: 10.222.0.26 Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABiwq4HLUZjwc4xRi5IEQ2EqWLAm9zloN3UzipEivJBovdBEWfPPdVntuBLxs7Rfq_wysX0aYpKZM76bpNBcwNymNQl5Wrm-Dcrn7GlKz3xJwrYimPb5QWT8RQ331MCd33WkRgMRt8Afjde1MIYKv-iPnJYsFE0Y4NfGLTM3eukBJWD_tY Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Role: admin,member,reader Jul 04 09:08:23.536808 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Roles: admin,member,reader Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f0a53c420a84618ab851430c484608a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f0a53c420a84618ab851430c484608a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f0a53c420a84618ab851430c484608a"}]}] Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant-Id: 3f0a53c420a84618ab851430c484608a Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User: admin Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Id: 78c2f3799fc8459a9a6e05f14a552498 Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: method: > Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: exception: Flavor 451 could not be found. Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: action_args: {'id': '451'} Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:08:23.538342 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:23.539212 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 04 09:08:23.540275 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-ca7397f0-2ffa-4f64-9e88-66ab21efa87c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:08:23.541339 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-ca7397f0-2ffa-4f64-9e88-66ab21efa87c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012581 Jul 04 09:08:23.541339 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 4 09:08:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:08:24.378130 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:24.379163 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 04 09:08:24.379549 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:24.582710 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-7e04da0d-41cd-4138-8218-2c9b35cc3376 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:08:24.607068 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-7e04da0d-41cd-4138-8218-2c9b35cc3376 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.091419 Jul 04 09:08:24.607653 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 4 09:08:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:25.431488 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:25.432943 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Jul 04 09:08:25.433573 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:25.637036 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-1be20eaa-2d2e-413a-80c7-7536dc558751 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:08:25.657242 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-1be20eaa-2d2e-413a-80c7-7536dc558751 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087189 Jul 04 09:08:25.657784 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 4 09:08:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:26.488462 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:26.489539 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 04 09:08:26.489950 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:26.683404 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-c129a1cb-2eec-4770-a141-70c68c4ac432 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:08:26.702842 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-c129a1cb-2eec-4770-a141-70c68c4ac432 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075488 Jul 04 09:08:26.703311 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 4 09:08:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:27.527337 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:27.528335 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 04 09:08:27.528729 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:27.733920 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-420c4467-07de-4f9b-934f-55e87794534a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:08:27.755048 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-420c4467-07de-4f9b-934f-55e87794534a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.087211 Jul 04 09:08:27.755579 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 4 09:08:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:08:28.577204 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:28.578233 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 04 09:08:28.578618 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:08:28.774647 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-315e27ca-5cb9-44c4-a0b1-61500742948e admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:08:28.794406 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-315e27ca-5cb9-44c4-a0b1-61500742948e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079078 Jul 04 09:08:28.794868 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon Jul 4 09:08:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:09:15.366193 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:09:15.367199 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fb8429df-2e3a-41b8-91b4-74e39b538294 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 04 09:09:15.367597 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 4 09:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:09:15.378403 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:15.440492 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-c17b3bff-bad6-4b99-a2f5-6f63d02c8c4f admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:09:15.459539 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-c17b3bff-bad6-4b99-a2f5-6f63d02c8c4f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.085969 Jul 04 09:09:15.460074 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 4 09:09:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:09:15.483281 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-aae905ff-c5c0-415d-a4db-1c86166d8ae0 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:09:15.486828 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=14 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:09:15.492341 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-aae905ff-c5c0-415d-a4db-1c86166d8ae0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012681 Jul 04 09:09:15.492865 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 4 09:09:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:15.504487 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-912027b0-a0a5-4659-97a2-28032968a56f admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:09:15.513139 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-912027b0-a0a5-4659-97a2-28032968a56f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012275 Jul 04 09:09:15.513657 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 4 09:09:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:15.525526 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:09:15.533861 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011995 Jul 04 09:09:15.534396 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 4 09:09:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:09:15.545690 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-324288f9-153b-41dc-86c6-3f34a347f3fd admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:09:15.553815 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-324288f9-153b-41dc-86c6-3f34a347f3fd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011650 Jul 04 09:09:15.554381 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 4 09:09:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:44.049630 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:44.050684 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 04 09:12:44.051078 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:44.205422 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=6 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:44.337146 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-7cb81861-55b1-472e-8c4e-8516549cfba4 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:44.338374 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:44.338374 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 04 09:12:44.339675 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-7cb81861-55b1-472e-8c4e-8516549cfba4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:44.340111 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-7cb81861-55b1-472e-8c4e-8516549cfba4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:44.340896 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-7cb81861-55b1-472e-8c4e-8516549cfba4 admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:44.341319 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-7cb81861-55b1-472e-8c4e-8516549cfba4 admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:44.375514 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-7cb81861-55b1-472e-8c4e-8516549cfba4 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.172694 Jul 04 09:12:44.376065 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 4 09:12:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:45.217825 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:45.218875 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 04 09:12:45.219265 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:45.419099 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-0ba65187-8ba7-40ef-ba59-ff4d5658c430 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:45.420388 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:45.420388 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 04 09:12:45.421565 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-0ba65187-8ba7-40ef-ba59-ff4d5658c430 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:45.422094 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-0ba65187-8ba7-40ef-ba59-ff4d5658c430 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:45.422879 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-0ba65187-8ba7-40ef-ba59-ff4d5658c430 admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:45.423303 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-0ba65187-8ba7-40ef-ba59-ff4d5658c430 admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:45.443816 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-0ba65187-8ba7-40ef-ba59-ff4d5658c430 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083531 Jul 04 09:12:45.444380 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 4 09:12:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:56.725270 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:56.726311 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 04 09:12:56.726710 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:56.872541 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=4 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:56.873260 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell1:SELECT=4 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:56.874119 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=8 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:56.923506 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-5eff07cd-8de2-4531-8b95-596f00008c8a admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:56.924655 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:56.924655 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 04 09:12:56.925837 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-5eff07cd-8de2-4531-8b95-596f00008c8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:56.926304 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-5eff07cd-8de2-4531-8b95-596f00008c8a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:56.927132 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-5eff07cd-8de2-4531-8b95-596f00008c8a admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:56.927511 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-5eff07cd-8de2-4531-8b95-596f00008c8a admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:56.952083 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-5eff07cd-8de2-4531-8b95-596f00008c8a admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085739 Jul 04 09:12:56.952638 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 4 09:12:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:12:57.778755 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:57.779873 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-423c5ca2-62fd-46f9-a2ab-2a5d1d3a5887 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 04 09:12:57.780275 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:57.979070 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b3416de4-1351-40e5-aae7-79b3be0e8612 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:57.980242 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:57.980242 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 04 09:12:57.981419 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-b3416de4-1351-40e5-aae7-79b3be0e8612 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:57.981858 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-b3416de4-1351-40e5-aae7-79b3be0e8612 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:57.982668 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-b3416de4-1351-40e5-aae7-79b3be0e8612 admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:12:57.983092 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-b3416de4-1351-40e5-aae7-79b3be0e8612 admin admin] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:12:58.004597 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b3416de4-1351-40e5-aae7-79b3be0e8612 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085198 Jul 04 09:12:58.005136 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 4 09:12:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:13:55.676969 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: Mon Jul 4 09:13:55 2022 - graceful shutdown triggered... Jul 04 09:13:55.677090 dv-cinder-819149-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 04 09:13:55.678122 dv-cinder-819149-7-iscsi devstack@n-api.service[103264]: Gracefully killing worker 1 (pid: 103264)... Jul 04 09:13:55.678516 dv-cinder-819149-7-iscsi devstack@n-api.service[103266]: Gracefully killing worker 2 (pid: 103266)... Jul 04 09:13:56.679345 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: worker 1 buried after 1 seconds Jul 04 09:13:56.679345 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: worker 2 buried after 1 seconds Jul 04 09:13:56.679345 dv-cinder-819149-7-iscsi devstack@n-api.service[103252]: goodbye to uWSGI. Jul 04 09:13:56.681706 dv-cinder-819149-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 04 09:13:56.682632 dv-cinder-819149-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 04 09:13:56.687114 dv-cinder-819149-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 09:13:56.701000 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 09:13:56 2022] *** Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: nodename: dv-cinder-819149-7-iscsi Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: machine: x86_64 Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: clock source: unix Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: pcre jit disabled Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: detected number of CPU cores: 4 Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: current working directory: / Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: detected binary path: /usr/bin/uwsgi-core Jul 04 09:13:56.703047 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: your processes number limit is 47680 Jul 04 09:13:56.703909 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: your memory page size is 4096 bytes Jul 04 09:13:56.703909 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: detected max file descriptor number: 2048 Jul 04 09:13:56.703909 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: lock engine: pthread robust mutexes Jul 04 09:13:56.703909 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: thunder lock: enabled Jul 04 09:13:56.703909 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 09:13:56.703909 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 09:13:56.749176 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: Python main interpreter initialized at 0x5611cdd889c0 Jul 04 09:13:56.749176 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: python threads support enabled Jul 04 09:13:56.749176 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: your server socket listen backlog is limited to 100 connections Jul 04 09:13:56.749176 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: your mercy for graceful operations on workers is 90 seconds Jul 04 09:13:56.749631 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 09:13:56.749631 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: *** Operational MODE: preforking *** Jul 04 09:13:56.750769 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: *** uWSGI is running in multiple interpreter mode *** Jul 04 09:13:56.750769 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: spawned uWSGI master process (pid: 117777) Jul 04 09:13:56.750769 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: spawned uWSGI worker 1 (pid: 117793, cores: 1) Jul 04 09:13:56.750191 dv-cinder-819149-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 09:13:56.751148 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: spawned uWSGI worker 2 (pid: 117795, cores: 1) Jul 04 09:13:56.751234 dv-cinder-819149-7-iscsi devstack@n-api.service[117777]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 09:13:57.395455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:13:57.405410 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:13:58.579596 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:13:58.579596 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: from cryptography.utils import int_from_bytes Jul 04 09:13:58.580322 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:13:58.580322 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: from cryptography.utils import int_from_bytes Jul 04 09:13:58.601633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:13:58.601633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: from cryptography.utils import int_from_bytes Jul 04 09:13:58.602354 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:13:58.602354 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: from cryptography.utils import int_from_bytes Jul 04 09:14:01.038909 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:14:01.039528 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:14:01.039636 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:14:01.040022 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:14:01.040253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:14:01.040670 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:14:01.040760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:14:01.040856 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.040937 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.041024 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:14:01.041263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.041393 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:14:01.041548 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.041644 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:14:01.041926 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.042061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.042216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.042389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.042508 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.042700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.042878 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.043042 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.043320 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.043406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.043489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.043648 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.043742 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.044001 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.044150 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-7-iscsi {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.044327 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.044465 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.044656 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.044806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.044909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.045010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.045223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.045392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.045504 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-7-iscsi {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.045610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.045832 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.045989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.046191 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.046357 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.046460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.046698 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.046850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.047071 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.047178 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.047425 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.047564 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.047732 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.047865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.048053 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.048230 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.048356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.048545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.048640 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.048853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.048955 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.049168 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.049274 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.049506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.049610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.049824 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.049940 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.050184 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.050271 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-7-iscsi {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.050467 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.050569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.050783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.050892 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.051111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.051216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.051422 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.051518 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.051812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-7-iscsi {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.051914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.052121 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.052224 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.052437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.052748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.052981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.053130 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.053303 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.053419 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.053654 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.053777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.053984 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.054096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.054301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.054418 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.054601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.054710 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.054906 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.055007 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.055211 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.055307 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.055543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.055759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.055899 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056057 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056282 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056837 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.056941 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.057148 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.057252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.057459 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.057554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.057780 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.057875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.058047 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.058215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.058437 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.058585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.058670 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.058810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.059120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.059223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.059428 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.059519 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.059734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.059833 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.060038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.060130 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.060330 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.060427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.060583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.060684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.060907 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.061007 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.061214 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.061311 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.061529 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.061636 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.061857 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.062026 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.062177 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.062277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.062479 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.062583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.062786 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.062885 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.063097 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.063189 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.063407 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.063505 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.063715 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.063826 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.064033 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.064178 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.064352 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.064497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.064641 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.064785 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.064922 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.065078 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.065226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.065364 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.065533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.065693 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.065837 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.065965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.066152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.066297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.066467 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.066560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.066794 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.066900 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.067093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.067199 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.067341 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.067440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.067638 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.067741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.067936 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.068050 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.068248 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.068347 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.068551 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.068651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.068851 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.068951 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.069151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.069286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.069448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.069594 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.069750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.069841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.070074 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.070175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.070376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.070468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.070676 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.070766 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.070975 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.071066 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.071280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.071378 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.071582 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.071680 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.071883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.071973 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.072182 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.072276 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.072492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.072583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.072804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.072904 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.073103 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.073201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.073402 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.073515 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.073705 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.073947 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.074098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.074235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.074393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.074534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.074695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.074788 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.074995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.075093 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.075365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.075459 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.075677 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.075817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.075989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.076081 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.076299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.076432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.076610 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.076778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.076911 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.077008 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.077224 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.077325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.077522 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.077789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.077935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.078148 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.078288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.078454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.078602 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.078757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.078914 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.079057 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.079236 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.079359 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.079549 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.079652 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.079863 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.079955 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.080188 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.080284 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.080493 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.080585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.080795 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.080885 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.081107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.081199 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.081414 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.081503 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.081714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.081802 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.082040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.082147 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.082346 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.082438 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.082653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.082743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.082962 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.083060 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.083269 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.083360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.083576 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.083675 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.083879 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.083977 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.084201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.084342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.084512 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.084602 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.084823 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.084926 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.085135 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.085236 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.085443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.085535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.085763 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.085917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:14:01.086095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.086196 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.086405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.086539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.086714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.086814 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.087032 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.087122 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.087345 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.087435 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.087671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.087769 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.087983 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.088084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.088300 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.088392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.088616 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.088708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.088923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.089029 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.089236 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.089370 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.089605 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.089706 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.089946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.090056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.090261 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.090351 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.090584 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.090682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.090919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.091021 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.091232 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.091332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.091553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.091653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.091869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.091961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.092178 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.092268 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.092485 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.092588 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.092792 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.092884 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.093112 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.093214 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.093427 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.093524 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.093743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.093833 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.094082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.094183 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.094393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.094501 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.094701 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.094827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.095007 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.095106 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.095315 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.095415 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.095625 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.095724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.095954 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.096052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.096263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.096352 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.096574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.096675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.096882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.096987 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.097196 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.097286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.097504 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.097604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.097810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.097936 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.098141 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.098244 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.098445 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.098537 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.098750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.098854 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.099054 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.099145 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.099360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.099491 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.099662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.099765 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.099977 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.100068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.100303 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.100400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.100609 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.100739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.100924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.101020 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.101232 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.101322 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.101540 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.101646 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.101847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.101957 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.102177 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.102265 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.102479 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.102572 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.102784 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.102880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.103091 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.103260 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.103395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.103486 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.103714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.103813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.104025 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.104165 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.104328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.104427 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.104644 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.104746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.104945 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.105048 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.105295 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.105387 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.105606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.105754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.105936 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.106185 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.106277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.106511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.106603 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.106828 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.106935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.107145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.107244 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.107457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.107548 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.107766 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.107870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.108096 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.108191 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.108406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.108495 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.108713 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.108816 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.109032 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.109127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.109349 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.109446 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.109659 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.109760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.109983 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.110088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.110293 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.110392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.110595 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.110687 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.110895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.110985 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.111288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.111506 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.111604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.111804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.111895 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.112105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.112196 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.112407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.112506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.112708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.112817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.113008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.113106 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.113324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.113415 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.113628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.113726 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.113950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.114066 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.114252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.114343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.114552 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.114685 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.114892 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.114996 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.115195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.115289 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.115508 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.115598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.115820 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.115924 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.116129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.116225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.116437 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.116534 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.116743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.116847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.117055 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.117164 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.117360 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.117450 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.117665 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.117756 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.117994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.118085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.118301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.118405 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.118616 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.118715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.118922 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.119071 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.119238 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.119358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.119542 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.119665 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.119859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.119951 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.120164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.120255 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.120477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.120568 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.120810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.120913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.121143 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.121234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.121460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.121556 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.121777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.121867 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.122140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.122245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.122459 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.122557 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.122783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.122873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.123093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.123196 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.123400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.123500 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.123710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.123807 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.124018 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.124124 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.124323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.124413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.124636 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.124767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.124945 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.125084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.125265 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.125389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.125574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.125698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.125942 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.126077 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.126221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.126346 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.126540 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.126657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.126841 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.126965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.127152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.127275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.127466 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.127580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.127784 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.127901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.128089 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.128212 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.128399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.128516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.128716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.128833 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.129028 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.129143 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.129356 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.129471 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.129666 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.129786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.130026 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.130141 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.130333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.130463 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.130643 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.130759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.130982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.131110 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.131269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.131399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.131576 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.131801 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.131900 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.131986 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.132180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.132736 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.132857 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.132948 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.133102 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.133194 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.133408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.133511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.133717 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.133809 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.134063 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.134157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.134375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.134507 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.134692 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.134822 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.135007 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.135098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.135311 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.135404 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.135614 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.135715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.135932 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.136032 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.136240 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.136356 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.136620 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.136780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.136945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.137250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.137355 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.137561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.137650 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.137906 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.138045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.138230 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.138331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.138535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.138633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.138854 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.138943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.139165 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.139264 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.139474 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.139571 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.139792 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.139884 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.140117 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.140226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.140398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.140496 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.140704 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.140802 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.141014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.141111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.141324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.141459 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.141633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.141772 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.141960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.142068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.142269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.142369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.142576 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.142683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.142894 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.142985 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.143202 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.143294 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.143510 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.143614 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.143820 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.143919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.144121 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.144221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.144427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.144533 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.144739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.144839 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.145058 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.145321 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.145423 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.145656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.145770 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.146006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.146102 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.146323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.146422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.146640 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.146743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.146955 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.147056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.147263 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.147362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.147577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.147677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.147953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.148059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.148214 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.148476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.148569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.148812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.148914 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.149496 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.149632 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.149744 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.149853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150016 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150141 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150253 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150362 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150711 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150822 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.150929 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.151064 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.151180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.153738 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.153867 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.154039 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.154154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.154265 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.154391 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.154503 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.154618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.154736 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.155398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.155514 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.155611 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.155697 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.155781 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.155864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.155962 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156140 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156231 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156317 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156407 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156541 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156630 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156720 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156806 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156902 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.156976 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157158 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157596 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157689 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157769 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.157989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158090 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158172 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158256 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158575 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158667 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158751 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158830 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158830 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.158982 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159078 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159171 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159243 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159522 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.159926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.160127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.160217 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.160433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.160538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.160736 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.160827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.161050 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.161151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.161362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.161538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.161662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.161754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.161982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.162078 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.162293 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.162400 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.162600 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.162691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.162901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.162990 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.163208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.163308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.163507 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.163598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.163819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.163909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.164122 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.164214 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.164423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.164520 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.164722 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.164819 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.165027 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.165146 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.165332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.165455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.165627 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.165720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.165965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.166062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.166273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.166362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.166574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.166665 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.166877 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.166978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.167184 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.167283 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.167486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.167631 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.167834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.167924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.168163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.168261 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.168439 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.168609 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.168750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.168840 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.169052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.169143 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.169359 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.169464 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.169661 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.169759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.169988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.170085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.170294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.170396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.170601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.170693 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.170900 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.170995 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.171199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.171297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.171503 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.171608 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.171804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.171895 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.172105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.172199 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.172420 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.172513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.172728 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.172819 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.173028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.173121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.173329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.173420 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.173628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.173726 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.173960 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.174055 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.174273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.174376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.174583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.174693 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.174890 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.174990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.175198 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.175317 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.175592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.175710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.175805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.175896 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.176105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.176196 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.176419 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.176520 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.176721 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.176814 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.177024 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.177115 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.177331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.177434 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.177639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.177732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.177968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.178064 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.178271 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.178370 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.178588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.178898 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.178996 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.179206 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.179307 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.179526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.179625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.179839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.179928 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.180159 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.180257 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.180463 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.180555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.180771 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.180877 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.181078 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.181178 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.181390 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.181486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.181694 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.181829 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.182023 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.182156 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.182333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.182429 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.182644 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.182735 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.182954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.183046 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.183301 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.183402 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.183629 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.183721 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.183959 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.184059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.184272 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.184364 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.184589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.184688 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.184905 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.185005 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.185220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.185329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.186426 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.186560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.186663 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.186750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.186834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.186918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187100 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187186 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187463 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187655 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187747 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187832 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.187971 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.188137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.188285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.188443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.188593 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.188751 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.188919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.189061 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.189233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.189378 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.189542 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.189734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.189853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.190129 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.190236 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.190482 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.190573 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.190791 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.190882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.191195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.191306 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.191462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.191561 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.191766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.191857 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.192068 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.192168 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.192378 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.192479 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.192700 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.192792 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.193003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.193104 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.193306 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.193413 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.193631 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.193729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.194003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.194099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.194308 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.194399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.194631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.194734 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.194989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.195080 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.195299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.195439 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.195607 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.195724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.195922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.196014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.196252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.196354 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.196563 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.196666 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.196873 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.196971 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.197182 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.197280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.197509 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.197678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.197818 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.197925 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.198153 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.198251 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.198460 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.198583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.198798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.198947 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.199172 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.199266 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.199572 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.199672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.199890 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.199991 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.200194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.200294 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.200515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.200616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.200837 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.200929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.201149 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.201249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.201474 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.201566 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.201810 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.201943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.202155 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.202255 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.202484 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.202575 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.202810 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.202901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.203126 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.203334 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.203445 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.203754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.203843 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.204082 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.204316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.204408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.204713 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.204810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.205039 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.205276 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.205457 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.205797 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.205954 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.206112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.206301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.206441 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.206774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.206876 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.207083 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.207274 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.207396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.207681 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.207773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.208003 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.208100 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.208312 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.208410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.208622 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.208713 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.208932 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.209021 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.209250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.209347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.209567 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.209665 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.209935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.210031 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.210211 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.210459 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.210563 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.210839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.210954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.211147 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.211281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.211475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.211613 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.211795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.211930 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.212120 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.212276 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.212448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.212587 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.212759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.212896 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.213086 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.213324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.213451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.213694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.213791 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.214032 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.214279 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.214372 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.214708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.214799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.215095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.215187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.215449 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.215589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.215784 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.215907 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.216115 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.216209 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.216429 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.216528 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.216837 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.216948 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.217096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.217418 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.217517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.217741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.217841 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.218100 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.218204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.218431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.218571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.218723 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.218815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.219038 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.219135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.219346 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.219446 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.219651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.219740 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.219956 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.220046 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.220263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.220364 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.220568 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.220657 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.220880 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.220970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.221184 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.221363 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.221510 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.221600 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.221817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.221943 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.222147 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.222248 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.222451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.222544 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.222755 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.222853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.223060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.223158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.223367 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.223466 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.223706 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.223796 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.224016 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.224106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.224334 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.224431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.224662 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.224815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.224968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.225084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.225288 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.225412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.225602 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.225717 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.225931 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.226072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.226248 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.226344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.226564 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.226664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.226888 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.226981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.227194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.227304 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.227506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.227610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.227811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.227901 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.228125 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.228217 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.228435 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.228539 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.228746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.228844 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.229060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.229301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.229400 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.229628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.229942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.230067 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.230310 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.230465 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.230623 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.230803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.230936 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.231129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.231252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.231454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.231554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.231782 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.231933 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.232102 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.232191 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.232426 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.232531 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.232746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.232846 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.233063 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.233153 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.233379 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.233479 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.233710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.233808 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.234050 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.234182 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.234368 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.234486 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.234682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.234774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.234998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.235097 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.235355 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.235457 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.235668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.235803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.235974 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.236079 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.236289 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.236414 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.236601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.236725 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.236915 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.237033 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.237230 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.237351 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.237541 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.237646 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.237851 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.238001 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.238185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.238286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.238496 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.238595 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.238805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.238897 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.239117 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.239208 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.239427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.239519 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.239740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.239839 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.240060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.240158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.240374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.240480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.240687 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.240778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.240998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.241096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.241315 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.241415 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.241650 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.241826 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.242492 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.242594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.242680 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.242785 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.242785 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.242950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.243107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.243207 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.243427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.243521 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.243746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.243846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.244073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.244165 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.244377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.244477 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.244679 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.244778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.244988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.245091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.245297 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.245397 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.245600 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.245718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.245965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.246113 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.246275 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.246400 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.246579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.246675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.246895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.246995 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.247204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.247302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.247510 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.247730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.247825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.248085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.248183 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.248400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.248655 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.248747 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.249012 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.249116 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.249334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.249425 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.249638 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.249736 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.249981 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.250088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.250290 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.250390 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.250594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.250685 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.250907 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.251002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.251222 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.251321 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.251524 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.251615 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.251827 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.251929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.252136 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.252236 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.252443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.252532 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.252741 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.252832 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.253048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.253140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.253360 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.253460 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.253667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.253765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.254006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.254102 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.254318 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.254428 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.254646 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.254744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.254955 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.255046 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.255256 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.255360 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.255557 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.255655 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.255862 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.255960 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.256165 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.256273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.256471 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.256567 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.256768 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.256865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.257076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.257177 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258813 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258920 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.258920 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.259082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.259214 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.259308 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.259660 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.259834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.259950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.260145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.260244 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.260454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.260553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.260775 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.260876 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.261089 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.261201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.261445 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.261551 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.261785 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.261916 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.262126 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.262218 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.262513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.262660 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.262864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.262998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.263189 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.263319 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.263654 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.263752 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.263988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.264092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.264297 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.264396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.264605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.264699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.264911 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.265010 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.265234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.265327 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.265548 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.265641 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.265861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.266049 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.266194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.266292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.266507 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.266644 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.266819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.266921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.267129 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.267255 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.267439 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.267562 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.267749 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.267842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.268067 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.268164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.268485 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.268588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.268720 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.268837 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.268978 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.269095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.269286 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.269387 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.269597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.269695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.269932 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.270028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.270251 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.270358 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.270566 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.270656 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.270880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.270971 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.271202 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.271295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.271513 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.271605 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.271820 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.271912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.272129 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.272228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.272436 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.272528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.272746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.272844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.273062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.273153 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.273372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.273461 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.273677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.273786 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.274038 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.274213 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.274361 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.274526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.274671 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.274845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.275163 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.275262 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.275472 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.275562 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.275791 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.275895 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.276112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.276202 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.276419 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.276512 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.276737 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.276830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.277084 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.277195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.277408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.277554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.277746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.277849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.278100 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.278195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.278427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.278539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.278736 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.278839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.279040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.279131 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.279342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.279655 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.279781 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.279978 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.280074 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.280284 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.280392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.280589 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.280699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.280888 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.280982 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.281202 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.281294 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.281505 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.281605 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.281806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.281926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.282133 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.282235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.282435 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.282534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.282742 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.282842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.283040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.283140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.283342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.283461 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.283641 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.283737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.283941 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.284047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.284242 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.284342 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.284541 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.284640 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.284847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.284950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.285146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.285244 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.285451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.285543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.285748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.285847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.286072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.286166 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.286374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.286502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.286680 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.286805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.286987 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.287082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.287295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.287394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.287603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.287696 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.287926 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.288024 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.288244 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.288343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.288554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.288656 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.288874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.288978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.289191 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.289286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.289505 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.289604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.289811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.289922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.290164 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.290267 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.290470 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.290561 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.290782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.290872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.291099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.291203 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.291407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.291504 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.291717 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.291810 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.292024 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.292124 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.292337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.292433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.292708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.292830 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.293016 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.293123 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.293332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.293431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.293645 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.293736 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.293985 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.294081 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.294305 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.294394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.294613 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.294704 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.294941 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.295040 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.295252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.295343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.295562 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.295663 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.295878 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.295974 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.296185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.296277 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.296494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.296650 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.296811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.296937 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.297129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.297229 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.297443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.297543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.297757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.297850 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.298088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.298188 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.298413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.298518 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.298738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.298863 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.299066 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.299189 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.299384 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.299483 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.299711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.299808 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.300036 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.300128 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.300348 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.300439 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.300657 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.300756 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.300963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.301053 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.301203 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:14:01.301346 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.301664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.302005 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.302317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:14:01.302563 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:14:01.364035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO dbcounter [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Registered counter for database nova_api Jul 04 09:14:01.365542 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Registered counter for database nova_api Jul 04 09:14:01.386687 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.388368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.394185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writer thread running {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.395531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.450820 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.context [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4410294-294c-406b-9aa4-054e5a299f2c(cell1) {{(pid=117795) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:14:01.452611 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.context [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4410294-294c-406b-9aa4-054e5a299f2c(cell1) {{(pid=117793) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:14:01.455195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:14:01.456743 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:14:01.456910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:14:01.457597 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:14:01.458358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:14:01.459165 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:14:01.459574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:14:01.461134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:14:01.461546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO dbcounter [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Registered counter for database nova_cell0 Jul 04 09:14:01.463168 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Registered counter for database nova_cell0 Jul 04 09:14:01.466188 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO dbcounter [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Registered counter for database nova_cell1 Jul 04 09:14:01.467662 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Registered counter for database nova_cell1 Jul 04 09:14:01.473704 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.478549 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writer thread running {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.479217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.479584 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.480578 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.488378 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.490249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.623563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writer thread running {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.634231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO dbcounter [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Registered counter for database nova_cell0 Jul 04 09:14:01.639529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Registered counter for database nova_cell0 Jul 04 09:14:01.642069 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.646524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:14:01.650602 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writer thread running {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.651080 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:14:01.967522 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: WARNING keystonemiddleware.auth_token [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:14:01.969785 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:14:01.974910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: WARNING keystonemiddleware.auth_token [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:14:01.977062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:14:02.312478 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: WARNING keystonemiddleware.auth_token [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:14:02.318502 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: WARNING keystonemiddleware.auth_token [None req-0a7c6bb3-f305-4e08-841d-afbd5e35dade None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:14:02.318741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:14:02.323757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611cdd889c0 pid: 117795 (default app) Jul 04 09:14:02.324766 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-6eaa1f62-56df-442c-a1bd-0c211676312c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:14:02.330074 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611cdd889c0 pid: 117793 (default app) Jul 04 09:14:43.350119 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:43.351816 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:43.352927 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:43.354134 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:43.582502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:43.587992 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:43.590123 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:43.591593 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:14:44.687771 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-25b5ba6f-760d-4b24-9246-88bc0c0981c4 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Action: 'create', calling method: .version_select at 0x7f8e82faf700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-998887457"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:14:44.881770 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1688cba1-503e-4229-84a8-284b5a87550f tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Action: 'create', calling method: .version_select at 0x7f8e82fac790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1834695742", "metadata": {"Type": "work"}}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:14:46.448857 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-25b5ba6f-760d-4b24-9246-88bc0c0981c4 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.127945 Jul 04 09:14:46.450588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1154 bytes} [Mon Jul 4 09:14:43 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3132 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 09:14:46.464126 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-af7dca15-dcc7-4c6a-9b68-565c19b8a682 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e75550>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:46.597750 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1688cba1-503e-4229-84a8-284b5a87550f tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.025584 Jul 04 09:14:46.598689 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 4 09:14:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3028 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 04 09:14:46.612424 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c2c25247-24fd-4867-8ebe-3e905dce993c tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e755e0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:46.747818 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-af7dca15-dcc7-4c6a-9b68-565c19b8a682 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20" status: 200 len: 344 microversion: 2.1 time: 0.289070 Jul 04 09:14:46.748382 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:46 2022] GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 => generated 344 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:14:46.845939 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c2c25247-24fd-4867-8ebe-3e905dce993c tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 200 len: 353 microversion: 2.1 time: 0.238340 Jul 04 09:14:46.850846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:46 2022] GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:14:47.777377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-647b894b-f995-47a1-95ab-6b1fcffa49e5 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e758b0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:47.868252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f827f0b4-1acf-4caa-9e22-a2ba7023c2e3 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e75700>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:47.961016 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-647b894b-f995-47a1-95ab-6b1fcffa49e5 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20" status: 200 len: 345 microversion: 2.1 time: 0.204364 Jul 04 09:14:47.961994 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:47 2022] GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:47.974162 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e35d62de-fdae-496c-8a68-7c99f0e26867 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Action: 'create', calling method: .version_select at 0x7f8e82e75c10>, body: {"snapshot": {"volume_id": "669dd433-0800-4549-b236-748f0b751d20", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1986320612"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:14:48.069782 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f827f0b4-1acf-4caa-9e22-a2ba7023c2e3 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 200 len: 354 microversion: 2.1 time: 0.215057 Jul 04 09:14:48.071295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:47 2022] GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:48.083109 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca2a1a09-94c1-42e1-9761-dbd7120c635f tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e75d30>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:48.617245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e35d62de-fdae-496c-8a68-7c99f0e26867 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.647019 Jul 04 09:14:48.623055 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 4/7] 10.222.0.26 () {60 vars in 1161 bytes} [Mon Jul 4 09:14:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:48.628899 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f43de0cd-b281-40aa-a5be-ec529b48ffd8 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8b8b0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:48.823801 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ca2a1a09-94c1-42e1-9761-dbd7120c635f tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 200 len: 354 microversion: 2.1 time: 0.744339 Jul 04 09:14:48.835418 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:48 2022] GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 354 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:48.841116 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-632bc623-b5cc-40ec-9438-06e7c5422f5e tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e86430>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:48.920266 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f43de0cd-b281-40aa-a5be-ec529b48ffd8 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 200 len: 287 microversion: 2.1 time: 0.295570 Jul 04 09:14:48.921193 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 4 09:14:48 2022] GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 287 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:48.930666 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bf16b736-9fe6-4461-abe1-59e74e389089 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e75ee0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:49.098985 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-632bc623-b5cc-40ec-9438-06e7c5422f5e tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 202 len: 0 microversion: 2.1 time: 0.261705 Jul 04 09:14:49.100449 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:14:48 2022] DELETE /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:14:49.107803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a9fa46ad-dd1c-42c2-bf85-f96a7c8b9467 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e75d30>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:49.174122 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bf16b736-9fe6-4461-abe1-59e74e389089 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.247154 Jul 04 09:14:49.174713 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 4 09:14:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:14:49.185922 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f0f02068-1dd2-4cc0-9d0d-a81e2f2027fd tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8baf0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:49.199221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a9fa46ad-dd1c-42c2-bf85-f96a7c8b9467 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 200 len: 353 microversion: 2.1 time: 0.095516 Jul 04 09:14:49.199794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:49 2022] GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:14:49.269951 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f0f02068-1dd2-4cc0-9d0d-a81e2f2027fd tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 200 len: 287 microversion: 2.1 time: 0.088663 Jul 04 09:14:49.271024 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 4 09:14:49 2022] GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:50.215444 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c8bd475e-f018-4fad-bc02-0f94264c6910 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e75700>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:50.284452 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c8af46cb-7fd9-4a8b-bda6-fde91290eb3f tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8b280>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:50.374798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c8af46cb-7fd9-4a8b-bda6-fde91290eb3f tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 200 len: 287 microversion: 2.1 time: 0.095900 Jul 04 09:14:50.376518 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 8/14] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 4 09:14:50 2022] GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:14:50.400352 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c8bd475e-f018-4fad-bc02-0f94264c6910 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 200 len: 353 microversion: 2.1 time: 0.190895 Jul 04 09:14:50.401288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 7/15] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:50 2022] GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:51.392071 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bb88c7ed-43c4-4fe9-8865-451119c3a1d7 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e758b0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:51.415981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8eea7b62-6d60-4f09-bf32-c181ea663f39 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e86670>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:51.460262 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bb88c7ed-43c4-4fe9-8865-451119c3a1d7 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 200 len: 287 microversion: 2.1 time: 0.076048 Jul 04 09:14:51.461131 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 4 09:14:51 2022] GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:51.501101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8eea7b62-6d60-4f09-bf32-c181ea663f39 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 200 len: 353 microversion: 2.1 time: 0.089993 Jul 04 09:14:51.501800 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:51 2022] GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:52.474826 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-538459d4-ab8f-436d-a02e-e9dd31b84b57 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e75e50>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:52.516560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f28b8c8-a1db-4048-b3fe-3f4ac82adf25 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Calling method '.version_select at 0x7f8e82e75700>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:52.539223 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-538459d4-ab8f-436d-a02e-e9dd31b84b57 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 200 len: 288 microversion: 2.1 time: 0.069865 Jul 04 09:14:52.540384 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 10/18] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 4 09:14:52 2022] GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 288 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:52.554049 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6c4c2b3e-7d45-473a-81bc-ca44cdf66972 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8b3a0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:52.605922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-7f28b8c8-a1db-4048-b3fe-3f4ac82adf25 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] HTTP exception thrown: Volume f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 could not be found. Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f28b8c8-a1db-4048-b3fe-3f4ac82adf25 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Request method failure captured: Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 HTTP/1.1 Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-DPW5n7lQh0t9GoNGKVBo_N2xPpzuK6y2meQjTKfkMRcA8rF01zcht5lnuBsoIzR1edW2kwMZMzhP_tryDgFsf1NVkzDXE4bZlertTSsmbc3ReRyRrYTmkRvKzgE9nwWaRIxK7WgKuHkUNM0CpCFxq7hGLIJOwhobMweIGyBi5CmY Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 13eb5bc141c34f99ab7b090ff2ea1146 Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesGetTestJSON-855958529 Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:14:52.621740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13eb5bc141c34f99ab7b090ff2ea1146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13eb5bc141c34f99ab7b090ff2ea1146", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13eb5bc141c34f99ab7b090ff2ea1146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13eb5bc141c34f99ab7b090ff2ea1146"}]}] Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesGetTestJSON-855958529 Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 13eb5bc141c34f99ab7b090ff2ea1146 Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesGetTestJSON-855958529 Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesGetTestJSON-855958529-project Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: cc12f51acc3945d08bc1fb277f77ec67 Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesGetTestJSON-855958529-project Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Volume f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 could not be found. Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'f2a3e1a6-805c-4036-a499-0fdc0f03d5c3'} Jul 04 09:14:52.623215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 could not be found. (HTTP 404) (Request-ID: req-c29f9a14-1b1a-47bf-8100-9e5581b9f8a7) Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:52.624088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:52.625170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 could not be found. Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:14:52.626287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 could not be found. Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 could not be found. Jul 04 09:14:52.627592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:14:52.632538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f28b8c8-a1db-4048-b3fe-3f4ac82adf25 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] Returning 404 to user: Volume f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:14:52.641933 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7f28b8c8-a1db-4048-b3fe-3f4ac82adf25 tempest-VolumesGetTestJSON-855958529 tempest-VolumesGetTestJSON-855958529-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3" status: 404 len: 109 microversion: 2.1 time: 0.131048 Jul 04 09:14:52.667939 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 9/19] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:52 2022] GET /compute/v2.1/os-volumes/f2a3e1a6-805c-4036-a499-0fdc0f03d5c3 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:14:52.802377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6c4c2b3e-7d45-473a-81bc-ca44cdf66972 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 202 len: 0 microversion: 2.1 time: 0.253905 Jul 04 09:14:52.809082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jul 4 09:14:52 2022] DELETE /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:14:52.812755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-94bead74-98f3-4b2d-a381-56c47b4d7e8e tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e83856c10>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:52.888009 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-94bead74-98f3-4b2d-a381-56c47b4d7e8e tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 200 len: 287 microversion: 2.1 time: 0.079782 Jul 04 09:14:52.888813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 4 09:14:52 2022] GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:14:53.901354 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-92217b12-2e5e-4c0a-b787-00d2b64f0de4 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8baf0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:53.992673 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-92217b12-2e5e-4c0a-b787-00d2b64f0de4 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] HTTP exception thrown: Snapshot f57c1e62-6fb0-49ff-a435-7bbc093e27c4 could not be found. Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-92217b12-2e5e-4c0a-b787-00d2b64f0de4 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Request method failure captured: Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 HTTP/1.1 Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-DtA44GKUG1E_vVlGqFS5eCVIqj5aCjs2IQV7FowtDobk4CCN2YlmRglWhWdmJcadJFsso3JUEYU-2FaD7vRfqe-lWoCwAfwggxIqQ9l87SaPRKLZpzAeCuLGZDH5tteBBwKpn6CxWYZDCJtdtDAFXNVASQlzBLs_ER7kr6U-lqUE Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:14:53.999028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80a6421aa9a94f0badd40600792880fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80a6421aa9a94f0badd40600792880fd"}]}] Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: ddea91415fb54f29a18db59ca41085aa Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Snapshot f57c1e62-6fb0-49ff-a435-7bbc093e27c4 could not be found. Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'f57c1e62-6fb0-49ff-a435-7bbc093e27c4'} Jul 04 09:14:54.000280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f57c1e62-6fb0-49ff-a435-7bbc093e27c4 could not be found. (HTTP 404) (Request-ID: req-dc5a1260-321a-4c5d-ac3c-158db525d4a2) Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:54.001045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:54.002039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f57c1e62-6fb0-49ff-a435-7bbc093e27c4 could not be found. Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 04 09:14:54.003009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f57c1e62-6fb0-49ff-a435-7bbc093e27c4 could not be found. Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f57c1e62-6fb0-49ff-a435-7bbc093e27c4 could not be found. Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-92217b12-2e5e-4c0a-b787-00d2b64f0de4 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Returning 404 to user: Snapshot f57c1e62-6fb0-49ff-a435-7bbc093e27c4 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:14:54.003968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-92217b12-2e5e-4c0a-b787-00d2b64f0de4 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4" status: 404 len: 111 microversion: 2.1 time: 0.104046 Jul 04 09:14:54.006240 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 12/22] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 4 09:14:53 2022] GET /compute/v2.1/os-snapshots/f57c1e62-6fb0-49ff-a435-7bbc093e27c4 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:14:54.011445 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c7557aad-52b7-46c8-8975-9a52e1ddf7f1 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e75a60>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:54.182324 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c7557aad-52b7-46c8-8975-9a52e1ddf7f1 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20" status: 202 len: 0 microversion: 2.1 time: 0.175543 Jul 04 09:14:54.184338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:14:54 2022] DELETE /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:14:54.196371 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1128e028-701d-43f4-a4da-727610fce852 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8bdc0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:54.339672 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1128e028-701d-43f4-a4da-727610fce852 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20" status: 200 len: 344 microversion: 2.1 time: 0.150030 Jul 04 09:14:54.342545 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:54 2022] GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:14:54.942990 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-248918548", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:14:55.195027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] validate_networks() for [('df1b751e-d6ba-48eb-89e1-23cec336922c', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:14:55.355106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e92ffea6-b6dd-4d61-866b-5cd6610dd35d tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8b1f0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:55.437503 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-e92ffea6-b6dd-4d61-866b-5cd6610dd35d tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] HTTP exception thrown: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e92ffea6-b6dd-4d61-866b-5cd6610dd35d tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Request method failure captured: Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 HTTP/1.1 Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-DtA44GKUG1E_vVlGqFS5eCVIqj5aCjs2IQV7FowtDobk4CCN2YlmRglWhWdmJcadJFsso3JUEYU-2FaD7vRfqe-lWoCwAfwggxIqQ9l87SaPRKLZpzAeCuLGZDH5tteBBwKpn6CxWYZDCJtdtDAFXNVASQlzBLs_ER7kr6U-lqUE Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:14:55.440045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80a6421aa9a94f0badd40600792880fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80a6421aa9a94f0badd40600792880fd"}]}] Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: ddea91415fb54f29a18db59ca41085aa Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '669dd433-0800-4549-b236-748f0b751d20'} Jul 04 09:14:55.441316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. (HTTP 404) (Request-ID: req-55733b00-4a92-4a46-a49f-b7ee21f40726) Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.442144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:55.443207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:14:55.444225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.445423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.446951 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e92ffea6-b6dd-4d61-866b-5cd6610dd35d tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Returning 404 to user: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:14:55.448043 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e92ffea6-b6dd-4d61-866b-5cd6610dd35d tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20" status: 404 len: 109 microversion: 2.1 time: 0.097945 Jul 04 09:14:55.449496 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:55 2022] GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:14:55.468490 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-956e9304-a7f6-4458-9514-91dba62845d9 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82dff670>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:55.549923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-956e9304-a7f6-4458-9514-91dba62845d9 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] HTTP exception thrown: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-956e9304-a7f6-4458-9514-91dba62845d9 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Request method failure captured: Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: DELETE /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 HTTP/1.1 Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-DtA44GKUG1E_vVlGqFS5eCVIqj5aCjs2IQV7FowtDobk4CCN2YlmRglWhWdmJcadJFsso3JUEYU-2FaD7vRfqe-lWoCwAfwggxIqQ9l87SaPRKLZpzAeCuLGZDH5tteBBwKpn6CxWYZDCJtdtDAFXNVASQlzBLs_ER7kr6U-lqUE Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:14:55.552059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80a6421aa9a94f0badd40600792880fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80a6421aa9a94f0badd40600792880fd"}]}] Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: ddea91415fb54f29a18db59ca41085aa Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '669dd433-0800-4549-b236-748f0b751d20'} Jul 04 09:14:55.553185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. (HTTP 404) (Request-ID: req-fde66dda-6651-4370-adbb-f1b9761e12bb) Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.553801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:14:55.554988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 09:14:55.555996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.556903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.558637 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-956e9304-a7f6-4458-9514-91dba62845d9 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Returning 404 to user: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:14:55.559826 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-956e9304-a7f6-4458-9514-91dba62845d9 tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20" status: 404 len: 109 microversion: 2.1 time: 0.097382 Jul 04 09:14:55.560661 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 15/26] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:14:55 2022] DELETE /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:14:55.572345 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3579f13c-6824-4cfd-8ec0-88410c5f38bc tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Calling method '.version_select at 0x7f8e82e8b1f0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:55.639470 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-3579f13c-6824-4cfd-8ec0-88410c5f38bc tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] HTTP exception thrown: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3579f13c-6824-4cfd-8ec0-88410c5f38bc tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Request method failure captured: Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 HTTP/1.1 Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-DtA44GKUG1E_vVlGqFS5eCVIqj5aCjs2IQV7FowtDobk4CCN2YlmRglWhWdmJcadJFsso3JUEYU-2FaD7vRfqe-lWoCwAfwggxIqQ9l87SaPRKLZpzAeCuLGZDH5tteBBwKpn6CxWYZDCJtdtDAFXNVASQlzBLs_ER7kr6U-lqUE Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:14:55.641451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80a6421aa9a94f0badd40600792880fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80a6421aa9a94f0badd40600792880fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80a6421aa9a94f0badd40600792880fd"}]}] Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 80a6421aa9a94f0badd40600792880fd Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1172211647 Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: ddea91415fb54f29a18db59ca41085aa Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1172211647-project Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '669dd433-0800-4549-b236-748f0b751d20'} Jul 04 09:14:55.642604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. (HTTP 404) (Request-ID: req-4bac3b53-5b6f-4ab9-9c9b-586c28f842a8) Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.643444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:14:55.644347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:14:55.645257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. Jul 04 09:14:55.646173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:14:55.651261 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3579f13c-6824-4cfd-8ec0-88410c5f38bc tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] Returning 404 to user: Volume 669dd433-0800-4549-b236-748f0b751d20 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:14:55.652692 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3579f13c-6824-4cfd-8ec0-88410c5f38bc tempest-VolumesSnapshotsTestJSON-1172211647 tempest-VolumesSnapshotsTestJSON-1172211647-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20" status: 404 len: 109 microversion: 2.1 time: 0.087632 Jul 04 09:14:55.653782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 16/27] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:14:55 2022] GET /compute/v2.1/os-volumes/669dd433-0800-4549-b236-748f0b751d20 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:14:58.079043 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:14:58.079916 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:14:58.080392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:14:58.080795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:14:58.081206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:14:58.125168 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:14:58.125872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:14:58.129294 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:14:58.134586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:14:58.257687 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for project 48690ebc49824572a08f53597eeee661. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:14:58.282216 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for user 1e916bf18efe421895c8d7b28fcd55d5 and project 48690ebc49824572a08f53597eeee661. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:14:58.348139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:14:58.358778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:14:58.544095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7c1b3d79-2475-44e7-b61a-4c6f4e93faaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.943761 Jul 04 09:14:58.546254 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 12/28] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:14:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:14:58.563297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f6018a15-cd24-4ebc-bf6a-125e8d847519 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:14:58.563816 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f6018a15-cd24-4ebc-bf6a-125e8d847519 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:14:58.805495 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f6018a15-cd24-4ebc-bf6a-125e8d847519 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:14:58.838471 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f6018a15-cd24-4ebc-bf6a-125e8d847519 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1221 microversion: 2.1 time: 0.284358 Jul 04 09:14:58.841918 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 13/29] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:14:58 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:14:59.334084 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1695698228", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "networks": [{"uuid": "ebe06835-bf96-4b89-ad2f-00c9514a77a0"}]}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:14:59.554631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] validate_networks() for [('ebe06835-bf96-4b89-ad2f-00c9514a77a0', None, None, None, None, None)] {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:15:00.174017 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4acc098c-0412-44e4-89b9-45e6fc5ae528 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'create', calling method: .version_select at 0x7f8e824fa550>, body: {"keypair": {"name": "tempest-keypair-96755608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4xOwNWgBEX2BrtpJX2vt2pOy7aycYOxalb6/GnRlsFfWr7+5bi7V6fcwVqzKpOyJfPBocZb28WP9/ELpwZoSj/83jCVyG9gqcccuZ2ugGP+7UO6ZXVWZ1V4TVaYKMZYA=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:00.237746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-4acc098c-0412-44e4-89b9-45e6fc5ae528 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:15:00.263652 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-4acc098c-0412-44e4-89b9-45e6fc5ae528 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for user 43bcd8fb25604011bfd1df823ea4ddad and project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:15:00.388174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4acc098c-0412-44e4-89b9-45e6fc5ae528 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.144961 Jul 04 09:15:00.390581 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 14/30] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:14:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:15:00.400051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-891304143", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:00.585710 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] validate_networks() for [('df1b751e-d6ba-48eb-89e1-23cec336922c', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:15:02.906409 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:15:02.907029 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:15:02.907280 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:15:02.907684 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:15:02.908094 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:15:02.914121 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:15:02.914687 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:15:02.915165 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:15:02.915575 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:15:02.915982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:15:02.930023 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:02.930473 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:02.931439 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:02.931897 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:02.946567 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:02.947346 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:02.950651 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:02.952803 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:02.964783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for project 48690ebc49824572a08f53597eeee661. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:15:02.969872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for user 1e916bf18efe421895c8d7b28fcd55d5 and project 48690ebc49824572a08f53597eeee661. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:15:02.987259 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:15:02.989688 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:15:03.045288 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Getting quotas for project 13c95b6f91e84cd498cc57c55253a477. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:15:03.075272 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Getting quotas for user cb99f1e73a214b4ab32102a9ab5670fb and project 13c95b6f91e84cd498cc57c55253a477. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:15:03.110332 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:15:03.114221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:15:03.153364 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-11e9fa20-8880-49ee-81d7-756eeb942e98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.758808 Jul 04 09:15:03.158128 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 15/31] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:15:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:15:03.367991 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9ccd7520-fc83-4da7-a933-af8e529c2700 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.974036 Jul 04 09:15:03.368638 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 17/32] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 09:15:03.380836 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-873d8dfa-d66d-41d6-9992-66813a674239 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:03.391883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-873d8dfa-d66d-41d6-9992-66813a674239 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:03.610563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-873d8dfa-d66d-41d6-9992-66813a674239 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:03.633598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-873d8dfa-d66d-41d6-9992-66813a674239 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1221 microversion: 2.1 time: 0.263234 Jul 04 09:15:03.634943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 18/33] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:03 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:03.640839 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bae7d2d6-e5c6-4edf-b813-08e34b2ef7fc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:03.641946 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-bae7d2d6-e5c6-4edf-b813-08e34b2ef7fc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:03.741863 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bae7d2d6-e5c6-4edf-b813-08e34b2ef7fc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:03.762083 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bae7d2d6-e5c6-4edf-b813-08e34b2ef7fc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1215 microversion: 2.1 time: 0.121994 Jul 04 09:15:03.763873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 19/34] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:03 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:03.833228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5176a57-3520-44ea-8bdc-864e9dbc82e7 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Action: 'create', calling method: .version_select at 0x7f8e81ca6820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1441203920", "metadata": {"Type": "work"}}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5176a57-3520-44ea-8bdc-864e9dbc82e7 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Request method failure captured: Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 122 Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-WWdC0tLRjsUYfDNV1ct0ZqQuesuzv20TcfhSFArKM0hhI7xgmmgou_Z9DD68wEuJx9fFKNfpJY6tIkkHk5OkASlk8v9pEVVCadaHD72YkumEKbg28Ez9ScpfE_Ptx6FmXM7d6wGQzLbgqIZ_l3JlJD74xdRBCzDpw5kMF88VcbMI Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:15:03.858285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_66c6b679f279407ab7a6e3ddace7ce51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/66c6b679f279407ab7a6e3ddace7ce51"}]}] Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 7e3ad9b60e3846adaf6a688aae2ad8a0 Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1441203920", "metadata": {"Type": "work"}}} Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: Jul 04 09:15:03.859965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1441203920', 'metadata': {'Type': 'work'}}}} Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise error Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi '#$%' Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:15:03.860690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 09:15:03.862101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 09:15:03.863341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 09:15:03.863341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.864112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5176a57-3520-44ea-8bdc-864e9dbc82e7 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:15:03.865296 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b5176a57-3520-44ea-8bdc-864e9dbc82e7 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.705873 Jul 04 09:15:03.868044 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 16/35] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 4 09:15:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 709 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:15:03.879953 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-37d5a790-5c3f-4dd5-9842-db37c10fbc68 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Action: 'create', calling method: .version_select at 0x7f8e81caaaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-928380832", "metadata": {"Type": "work"}}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-37d5a790-5c3f-4dd5-9842-db37c10fbc68 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Request method failure captured: Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 119 Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-WWdC0tLRjsUYfDNV1ct0ZqQuesuzv20TcfhSFArKM0hhI7xgmmgou_Z9DD68wEuJx9fFKNfpJY6tIkkHk5OkASlk8v9pEVVCadaHD72YkumEKbg28Ez9ScpfE_Ptx6FmXM7d6wGQzLbgqIZ_l3JlJD74xdRBCzDpw5kMF88VcbMI Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:15:03.885952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_66c6b679f279407ab7a6e3ddace7ce51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/66c6b679f279407ab7a6e3ddace7ce51"}]}] Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 7e3ad9b60e3846adaf6a688aae2ad8a0 Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-928380832", "metadata": {"Type": "work"}}} Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: Jul 04 09:15:03.887056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-928380832', 'metadata': {'Type': 'work'}}}} Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise error Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi '0' Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:15:03.887766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 09:15:03.888870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 09:15:03.889802 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 09:15:03.889802 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.889802 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-37d5a790-5c3f-4dd5-9842-db37c10fbc68 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:15:03.890713 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-37d5a790-5c3f-4dd5-9842-db37c10fbc68 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015823 Jul 04 09:15:03.891863 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 20/36] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 4 09:15:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:15:03.902919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-04f13a9f-5f21-4a85-89a9-46687354812c tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Action: 'create', calling method: .version_select at 0x7f8e82e86ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1659379572", "metadata": {"Type": "work"}}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-04f13a9f-5f21-4a85-89a9-46687354812c tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Request method failure captured: Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 119 Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-WWdC0tLRjsUYfDNV1ct0ZqQuesuzv20TcfhSFArKM0hhI7xgmmgou_Z9DD68wEuJx9fFKNfpJY6tIkkHk5OkASlk8v9pEVVCadaHD72YkumEKbg28Ez9ScpfE_Ptx6FmXM7d6wGQzLbgqIZ_l3JlJD74xdRBCzDpw5kMF88VcbMI Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:15:03.905719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_66c6b679f279407ab7a6e3ddace7ce51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/66c6b679f279407ab7a6e3ddace7ce51"}]}] Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 7e3ad9b60e3846adaf6a688aae2ad8a0 Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1659379572", "metadata": {"Type": "work"}}} Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: Jul 04 09:15:03.907603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1659379572', 'metadata': {'Type': 'work'}}}} Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise error Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi '' Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:15:03.908406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 09:15:03.909729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 09:15:03.911657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 09:15:03.911657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:03.911657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-04f13a9f-5f21-4a85-89a9-46687354812c tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:15:03.914094 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-04f13a9f-5f21-4a85-89a9-46687354812c tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014529 Jul 04 09:15:03.915999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 17/37] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 4 09:15:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:15:03.936426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dcd03768-f9c9-4eb7-a4ea-7a43bf5ddf06 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Calling method '.version_select at 0x7f8e82dff5e0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:04.024771 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-dcd03768-f9c9-4eb7-a4ea-7a43bf5ddf06 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] HTTP exception thrown: Volume tempest-invalid-1004724008 could not be found. Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dcd03768-f9c9-4eb7-a4ea-7a43bf5ddf06 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Request method failure captured: Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1004724008 HTTP/1.1 Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-WWdC0tLRjsUYfDNV1ct0ZqQuesuzv20TcfhSFArKM0hhI7xgmmgou_Z9DD68wEuJx9fFKNfpJY6tIkkHk5OkASlk8v9pEVVCadaHD72YkumEKbg28Ez9ScpfE_Ptx6FmXM7d6wGQzLbgqIZ_l3JlJD74xdRBCzDpw5kMF88VcbMI Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:15:04.032989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_66c6b679f279407ab7a6e3ddace7ce51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/66c6b679f279407ab7a6e3ddace7ce51"}]}] Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 7e3ad9b60e3846adaf6a688aae2ad8a0 Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Volume tempest-invalid-1004724008 could not be found. Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'tempest-invalid-1004724008'} Jul 04 09:15:04.034457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1004724008 could not be found. (HTTP 404) (Request-ID: req-6557aaf2-9ed2-40c6-abaa-87d818558345) Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.035101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:15:04.036360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1004724008 could not be found. Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:15:04.037533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1004724008 could not be found. Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1004724008 could not be found. Jul 04 09:15:04.039579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.041765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dcd03768-f9c9-4eb7-a4ea-7a43bf5ddf06 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Returning 404 to user: Volume tempest-invalid-1004724008 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:15:04.044191 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dcd03768-f9c9-4eb7-a4ea-7a43bf5ddf06 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1004724008" status: 404 len: 99 microversion: 2.1 time: 0.122806 Jul 04 09:15:04.046503 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 21/38] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 4 09:15:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1004724008 => generated 99 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 04 09:15:04.056633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-476ac6d9-009f-4993-a07d-8526c3ab24cd tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004608 Jul 04 09:15:04.057273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 18/39] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 4 09:15:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 09:15:04.066923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d181c93d-655e-430f-96f1-d550fb5a6c90 tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003937 Jul 04 09:15:04.067675 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 22/40] 10.222.0.26 () {58 vars in 1136 bytes} [Mon Jul 4 09:15:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 09:15:04.078707 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ee94f16e-99f5-463b-a8d4-81281694feef tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Calling method '.version_select at 0x7f8e81cc6a60>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:04.201308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-ee94f16e-99f5-463b-a8d4-81281694feef tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] HTTP exception thrown: Volume bb37a828-31ce-47a7-8437-a679fea948ab could not be found. Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ee94f16e-99f5-463b-a8d4-81281694feef tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Request method failure captured: Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/os-volumes/bb37a828-31ce-47a7-8437-a679fea948ab HTTP/1.1 Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-WWdC0tLRjsUYfDNV1ct0ZqQuesuzv20TcfhSFArKM0hhI7xgmmgou_Z9DD68wEuJx9fFKNfpJY6tIkkHk5OkASlk8v9pEVVCadaHD72YkumEKbg28Ez9ScpfE_Ptx6FmXM7d6wGQzLbgqIZ_l3JlJD74xdRBCzDpw5kMF88VcbMI Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:15:04.204092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_66c6b679f279407ab7a6e3ddace7ce51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/66c6b679f279407ab7a6e3ddace7ce51"}]}] Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 7e3ad9b60e3846adaf6a688aae2ad8a0 Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Volume bb37a828-31ce-47a7-8437-a679fea948ab could not be found. Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'bb37a828-31ce-47a7-8437-a679fea948ab'} Jul 04 09:15:04.205203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb37a828-31ce-47a7-8437-a679fea948ab could not be found. (HTTP 404) (Request-ID: req-3b278fa2-6254-489e-ac76-40031e9dee40) Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.205855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:15:04.206866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb37a828-31ce-47a7-8437-a679fea948ab could not be found. Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 09:15:04.207825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb37a828-31ce-47a7-8437-a679fea948ab could not be found. Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb37a828-31ce-47a7-8437-a679fea948ab could not be found. Jul 04 09:15:04.208773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.211792 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ee94f16e-99f5-463b-a8d4-81281694feef tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Returning 404 to user: Volume bb37a828-31ce-47a7-8437-a679fea948ab could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:15:04.212909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ee94f16e-99f5-463b-a8d4-81281694feef tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/bb37a828-31ce-47a7-8437-a679fea948ab" status: 404 len: 109 microversion: 2.1 time: 0.139359 Jul 04 09:15:04.213569 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:15:04 2022] DELETE /compute/v2.1/os-volumes/bb37a828-31ce-47a7-8437-a679fea948ab => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:15:04.223603 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-69683459-9ba8-4476-b3cf-53c597a377ba tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Calling method '.version_select at 0x7f8e824fe1f0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:04.424445 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-69683459-9ba8-4476-b3cf-53c597a377ba tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] HTTP exception thrown: Volume a1973749-b403-44fa-8af8-8659e24460c6 could not be found. Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-69683459-9ba8-4476-b3cf-53c597a377ba tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Request method failure captured: Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/os-volumes/a1973749-b403-44fa-8af8-8659e24460c6 HTTP/1.1 Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-WWdC0tLRjsUYfDNV1ct0ZqQuesuzv20TcfhSFArKM0hhI7xgmmgou_Z9DD68wEuJx9fFKNfpJY6tIkkHk5OkASlk8v9pEVVCadaHD72YkumEKbg28Ez9ScpfE_Ptx6FmXM7d6wGQzLbgqIZ_l3JlJD74xdRBCzDpw5kMF88VcbMI Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:15:04.426812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_66c6b679f279407ab7a6e3ddace7ce51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/66c6b679f279407ab7a6e3ddace7ce51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/66c6b679f279407ab7a6e3ddace7ce51"}]}] Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 66c6b679f279407ab7a6e3ddace7ce51 Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesNegativeTest-905494879 Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 7e3ad9b60e3846adaf6a688aae2ad8a0 Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesNegativeTest-905494879-project Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Volume a1973749-b403-44fa-8af8-8659e24460c6 could not be found. Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'a1973749-b403-44fa-8af8-8659e24460c6'} Jul 04 09:15:04.427914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1973749-b403-44fa-8af8-8659e24460c6 could not be found. (HTTP 404) (Request-ID: req-30181a27-d1ae-44a1-9bea-5c166d9d327f) Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.428579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:15:04.429515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1973749-b403-44fa-8af8-8659e24460c6 could not be found. Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:15:04.430477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a1973749-b403-44fa-8af8-8659e24460c6 could not be found. Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1973749-b403-44fa-8af8-8659e24460c6 could not be found. Jul 04 09:15:04.431486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:15:04.438128 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-69683459-9ba8-4476-b3cf-53c597a377ba tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] Returning 404 to user: Volume a1973749-b403-44fa-8af8-8659e24460c6 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:15:04.438128 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-69683459-9ba8-4476-b3cf-53c597a377ba tempest-VolumesNegativeTest-905494879 tempest-VolumesNegativeTest-905494879-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a1973749-b403-44fa-8af8-8659e24460c6" status: 404 len: 109 microversion: 2.1 time: 0.218145 Jul 04 09:15:04.438128 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 23/42] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:15:04 2022] GET /compute/v2.1/os-volumes/a1973749-b403-44fa-8af8-8659e24460c6 => generated 109 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:15:04.653637 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cbebbbdc-dba0-4035-9dc3-d4d06408712e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:04.654769 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cbebbbdc-dba0-4035-9dc3-d4d06408712e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:04.753869 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cbebbbdc-dba0-4035-9dc3-d4d06408712e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:04.761425 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cbebbbdc-dba0-4035-9dc3-d4d06408712e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1221 microversion: 2.1 time: 0.114317 Jul 04 09:15:04.773557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:04 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:04.783377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:04.784646 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:04.793409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:04.794209 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:04.795212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:04.795912 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:05.123281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:05.142096 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-79279052-8d3c-4803-98f4-e974528f2298 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1219 microversion: 2.1 time: 0.364853 Jul 04 09:15:05.152621 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 24/44] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:04 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1219 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:05.780328 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:05.780973 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:05.800543 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:05.813370 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:05.814297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:05.814755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:06.162186 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:06.163715 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:06.182403 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:06.185406 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:06.188435 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:06.189606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:06.244887 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:06.279660 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c9929b6d-7191-44fe-8fce-c60e73c0666a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1217 microversion: 2.1 time: 0.503074 Jul 04 09:15:06.303897 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 21/45] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:05 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1217 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:06.322361 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-545936328", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d34116fb-495d-48d9-8d0c-0773d154a526"}], "security_groups": [{"name": "tempest-securitygroup--1325584690"}], "key_name": "tempest-keypair-96755608", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:06.425264 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:06.454048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6491adcc-5e48-4823-ab81-598654a8c0df tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1267 microversion: 2.1 time: 0.295787 Jul 04 09:15:06.455411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 25/46] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:06 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:06.876475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] validate_networks() for [('d34116fb-495d-48d9-8d0c-0773d154a526', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:15:07.298543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:07.300006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:07.310500 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:07.312031 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:07.315028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:07.315596 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:07.460196 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:07.492709 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2c801ba9-ae15-4aaf-8a74-0770b93805c7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1281 microversion: 2.1 time: 0.199056 Jul 04 09:15:07.503483 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 26/47] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:07 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:07.511573 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:07.512342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:07.521676 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:07.522967 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:07.526285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:07.527191 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:07.791038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:07.803707 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b1e89652-cde1-49f8-84fa-23c1f0361461 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1285 microversion: 2.1 time: 0.298763 Jul 04 09:15:07.804122 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 27/48] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:07 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1285 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:07.907982 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:15:07.908997 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:15:07.909606 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:15:07.910174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:15:07.910742 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:15:07.926911 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:07.928577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:07.929719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:07.931963 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:07.959121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:15:07.963221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for user 43bcd8fb25604011bfd1df823ea4ddad and project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:15:07.974277 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:15:07.976418 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:15:08.046601 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-29079773-65e6-4c02-a5b5-74a71386c013 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.740111 Jul 04 09:15:08.047761 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 22/49] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:15:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:15:08.059553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b2649eeb-4114-4439-a61e-223cab247bc7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:08.060690 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b2649eeb-4114-4439-a61e-223cab247bc7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:08.134871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b2649eeb-4114-4439-a61e-223cab247bc7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:08.146615 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b2649eeb-4114-4439-a61e-223cab247bc7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1235 microversion: 2.1 time: 0.089068 Jul 04 09:15:08.162611 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 28/50] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:08 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1235 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:08.518231 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:08.519343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:08.535254 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:08.538835 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:08.539971 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:08.540640 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:08.704702 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:08.718818 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ab33c665-f427-4820-99c5-aaa6cfbd8511 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1281 microversion: 2.1 time: 0.207884 Jul 04 09:15:08.722343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 23/51] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:08 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:08.822460 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:08.824477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:08.837664 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:08.838734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:08.840065 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:08.841427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:08.950799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:08.967234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-41431bbb-60d5-4d24-bdf4-d9d3d521b4ab tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1285 microversion: 2.1 time: 0.149344 Jul 04 09:15:08.969087 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 29/52] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:08 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:09.165397 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:09.167094 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:09.174108 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:09.174550 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:09.175497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:09.176066 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:09.245125 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:09.253972 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-59771c17-9d61-4ce6-8882-fb1b1fbf490c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1239 microversion: 2.1 time: 0.092564 Jul 04 09:15:09.254917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 24/53] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:09 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:09.740389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:09.741309 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:09.762874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:09.765669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:09.767055 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:09.767681 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:09.985437 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:09.986331 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:09.995558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:09.998966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:09.999966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:10.002725 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:10.161423 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:10.171375 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ce7fa8b1-7a4e-43f7-b29b-cca42d5f6ec4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1273 microversion: 2.1 time: 0.190084 Jul 04 09:15:10.174226 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 25/54] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:09 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:10.187346 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:10.198597 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3be04456-ac96-4285-af0d-21e3ebbc7599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1291 microversion: 2.1 time: 0.461454 Jul 04 09:15:10.199204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 30/55] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:09 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1291 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:10.271714 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:10.272318 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:10.280250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:10.280869 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:10.282081 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:10.282526 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:10.366946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:10.378239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fb0f9d7d-528c-43e8-87d7-770239e40f7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1287 microversion: 2.1 time: 0.109619 Jul 04 09:15:10.378844 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 26/56] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:10 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:11.193564 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:11.194287 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:11.210050 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:11.211081 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:11.214941 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:11.216152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:11.216772 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:11.217729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:11.224679 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:11.234127 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:11.235433 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:11.235882 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:11.972434 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:12.010033 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-de6d563e-e503-4f35-9d6d-9d4bebea9dda tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1279 microversion: 2.1 time: 0.787120 Jul 04 09:15:12.018438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 27/57] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:11 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1279 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:12.028193 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:12.036695 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:12.055126 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:12.055670 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:12.075228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:12.075798 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:12.208190 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:12.223085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dcec500a-8562-48f3-91df-3e8a24e481b7 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 1.031693 Jul 04 09:15:12.239806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 31/58] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:11 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:12.589178 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:12.615323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4b668e44-2719-4878-947f-a1ca83c36bc6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1293 microversion: 2.1 time: 0.587610 Jul 04 09:15:12.621925 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:12 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1293 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:13.029587 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:13.030267 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:13.032443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:13.048215 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:13.049934 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:13.050748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:13.056737 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:13.243170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:13.246397 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:13.263204 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:13.264122 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:13.271866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:13.274443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:13.805932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:13.817088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0fca59f4-0443-41e7-a946-70cafb2e88cf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.790029 Jul 04 09:15:13.817757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 32/60] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:13 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:13.834755 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:13.835441 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:13.843376 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:13.851386 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:13.851513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d83bfa18-94bf-4a4d-af63-8e0b12501358 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.612004 Jul 04 09:15:13.855505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 29/61] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:13 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:13.858040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:13.861399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:13.861860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:14.233669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:14.246564 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b16c33a3-d356-40f4-ab06-12145791c1ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.426642 Jul 04 09:15:14.248494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 33/62] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:13 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:14.835238 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:14.836852 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:14.843614 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:14.844049 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:14.845698 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:14.846361 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:14.867239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-2071f4dc-e4e8-434c-aad6-2fe74edb6042 req-5d2f17d1-ab3f-4ccd-a245-64cedc1e770d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa", "tag": "e4032ca7-9968-41ab-84f4-ed9cfa71c82a"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:14.879879 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2071f4dc-e4e8-434c-aad6-2fe74edb6042 req-5d2f17d1-ab3f-4ccd-a245-64cedc1e770d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:14.880511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2071f4dc-e4e8-434c-aad6-2fe74edb6042 req-5d2f17d1-ab3f-4ccd-a245-64cedc1e770d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:14.902322 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-2071f4dc-e4e8-434c-aad6-2fe74edb6042 req-5d2f17d1-ab3f-4ccd-a245-64cedc1e770d service nova] Creating event network-changed:e4032ca7-9968-41ab-84f4-ed9cfa71c82a for instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa on hv-cinder-81914 Jul 04 09:15:14.903066 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2071f4dc-e4e8-434c-aad6-2fe74edb6042 req-5d2f17d1-ab3f-4ccd-a245-64cedc1e770d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 09:15:14.904166 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35cc6a3d-5d7b-4b29-8eb6-e03738321682 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:14.904947 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35cc6a3d-5d7b-4b29-8eb6-e03738321682 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:14.906055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35cc6a3d-5d7b-4b29-8eb6-e03738321682 None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:14.906648 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35cc6a3d-5d7b-4b29-8eb6-e03738321682 None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:14.915894 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.compute.rpcapi [None req-35cc6a3d-5d7b-4b29-8eb6-e03738321682 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 09:15:14.917051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35cc6a3d-5d7b-4b29-8eb6-e03738321682 None None] Releasing lock "compute-rpcapi-router" {{(pid=117793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 09:15:14.936908 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-35cc6a3d-5d7b-4b29-8eb6-e03738321682 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242434 Jul 04 09:15:14.937915 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 30/63] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:15:14.945824 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:14.946852 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:14.957180 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:14.958078 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:14.959463 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:14.959915 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:15.051494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:15.060603 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-72c6298b-7321-4391-8d77-aac69d95afaa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.229521 Jul 04 09:15:15.070565 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 34/64] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:14 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:15.124157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:15.159176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e10527bb-3294-4788-9ea0-7df2810ecb67 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.199374 Jul 04 09:15:15.173094 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 31/65] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:14 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:15.267656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:15.268364 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:15.291641 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:15.293305 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:15.295442 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:15.296889 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:15.537252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:15.552580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-231628ac-2b25-4f3e-a1e8-efc5819bcf2a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.290206 Jul 04 09:15:15.553471 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 35/66] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:15 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:16.078073 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:16.086452 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:16.096081 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:16.096858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:16.098157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:16.098833 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:16.188411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:16.189704 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:16.200204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:16.201162 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:16.203616 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:16.204447 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:16.717331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:16.726930 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b0318edb-83a0-4b2a-b51e-7e298b4938fb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.545146 Jul 04 09:15:16.727294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 36/67] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:16 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:16.733944 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:16.737427 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:16.755375 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-781a4d43-6de6-4f53-a481-cbe835632b81 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.680747 Jul 04 09:15:16.759456 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:16.759855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 32/68] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:16 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:16.772569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:16.775092 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:16.775946 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:16.776358 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:16.956278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-2173118f-5fd7-478c-bfc9-71ecf0f344ea req-9d3927bc-a628-49a6-93a5-2ebe5c1faa02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb12a448-abd1-4f71-a368-8e85bedaf38b", "tag": "4d51a8b6-0abd-4c35-b502-9d5ad3cc0c9d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:16.972464 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2173118f-5fd7-478c-bfc9-71ecf0f344ea req-9d3927bc-a628-49a6-93a5-2ebe5c1faa02 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:16.972945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2173118f-5fd7-478c-bfc9-71ecf0f344ea req-9d3927bc-a628-49a6-93a5-2ebe5c1faa02 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:16.991538 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:16.992200 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-2173118f-5fd7-478c-bfc9-71ecf0f344ea req-9d3927bc-a628-49a6-93a5-2ebe5c1faa02 service nova] Creating event network-changed:4d51a8b6-0abd-4c35-b502-9d5ad3cc0c9d for instance eb12a448-abd1-4f71-a368-8e85bedaf38b on hv-cinder-81914 Jul 04 09:15:17.003319 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8913fc7c-49a8-4cc0-8fcd-8c2600b44ff5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.273951 Jul 04 09:15:17.005834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 37/69] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:16 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:17.015911 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-2173118f-5fd7-478c-bfc9-71ecf0f344ea req-9d3927bc-a628-49a6-93a5-2ebe5c1faa02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061662 Jul 04 09:15:17.017910 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 33/70] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:15:17.749042 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:17.750577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:17.759680 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:17.760856 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:17.762533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:17.763268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:17.786602 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:17.788501 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:17.795751 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:17.796196 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:17.796955 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:17.797616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:17.971009 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=26 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:18.084617 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:18.096943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3ba204f7-ac39-40c3-8ac6-cc65c5398d52 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.357152 Jul 04 09:15:18.097539 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 38/71] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:17 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:18.120933 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:18.121565 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:18.148695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=12 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:18.160169 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:18.160850 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:18.161817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:18.166841 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:18.232668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:18.245638 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f9e2010d-7993-4d37-93c6-ca7a1853192e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.463249 Jul 04 09:15:18.259233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 34/72] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:17 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:18.662844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:18.675036 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-af3593da-9c29-425e-bd46-a7e6da79d9b9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.563048 Jul 04 09:15:18.677903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 39/73] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:18 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:19.113342 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:19.113979 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:19.121564 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:19.126434 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:19.128875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:19.131718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:19.267092 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:19.268404 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:19.277493 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:19.292967 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:19.295195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:19.295632 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:19.773147 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:19.781366 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-db05a65a-7044-4c7f-a21a-12e3e5cc8ae5 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.671690 Jul 04 09:15:19.784899 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 35/74] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:19 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:19.802413 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:19.803208 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:19.818732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:19.823343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:19.826214 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:19.827864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:19.833128 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:20.017095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:20.031106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6f96568c-934f-4562-b243-9132d593a6b4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.769496 Jul 04 09:15:20.031689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 40/75] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:19 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:20.039017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-dcfb01bd-c935-43d3-9cb6-043e11b7ca9f req-f6f63beb-11ee-43c6-9e33-27f435954f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf474beb-fb86-4571-a949-b4fde11c34db", "tag": "90432259-5748-4275-9dd4-31b28ac81966"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:20.059891 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-dcfb01bd-c935-43d3-9cb6-043e11b7ca9f req-f6f63beb-11ee-43c6-9e33-27f435954f5e service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:20.060634 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-dcfb01bd-c935-43d3-9cb6-043e11b7ca9f req-f6f63beb-11ee-43c6-9e33-27f435954f5e service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:20.073698 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=100 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:20.083805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-dcfb01bd-c935-43d3-9cb6-043e11b7ca9f req-f6f63beb-11ee-43c6-9e33-27f435954f5e service nova] Creating event network-changed:90432259-5748-4275-9dd4-31b28ac81966 for instance bf474beb-fb86-4571-a949-b4fde11c34db on hv-cinder-81914 Jul 04 09:15:20.084572 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-dcfb01bd-c935-43d3-9cb6-043e11b7ca9f req-f6f63beb-11ee-43c6-9e33-27f435954f5e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117795) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 09:15:20.085959 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c494f063-ceac-4767-b227-490e996bb9ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:20.087327 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c494f063-ceac-4767-b227-490e996bb9ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:20.088347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c494f063-ceac-4767-b227-490e996bb9ca None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:20.089078 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c494f063-ceac-4767-b227-490e996bb9ca None None] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:20.108416 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.compute.rpcapi [None req-c494f063-ceac-4767-b227-490e996bb9ca None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 09:15:20.109441 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c494f063-ceac-4767-b227-490e996bb9ca None None] Releasing lock "compute-rpcapi-router" {{(pid=117795) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 09:15:20.139480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c494f063-ceac-4767-b227-490e996bb9ca None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104503 Jul 04 09:15:20.140389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 41/76] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:15:20.305278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:20.333448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9f00b464-bf29-47e4-b647-2684d22388e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.546649 Jul 04 09:15:20.349400 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 36/77] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:19 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:20.713067 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-55ab87a5-a74e-410b-b38f-86833da9e8c3 req-fd1a4f4d-2fcd-4ba1-89c8-6f2fa9d45642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b908667b-9eab-4249-b81a-acd8c6e40e86", "tag": "232e0862-e534-47a3-801c-2e64bb8cb2cf"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:20.721724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-55ab87a5-a74e-410b-b38f-86833da9e8c3 req-fd1a4f4d-2fcd-4ba1-89c8-6f2fa9d45642 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:20.722190 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-55ab87a5-a74e-410b-b38f-86833da9e8c3 req-fd1a4f4d-2fcd-4ba1-89c8-6f2fa9d45642 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:20.732773 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-55ab87a5-a74e-410b-b38f-86833da9e8c3 req-fd1a4f4d-2fcd-4ba1-89c8-6f2fa9d45642 service nova] Creating event network-changed:232e0862-e534-47a3-801c-2e64bb8cb2cf for instance b908667b-9eab-4249-b81a-acd8c6e40e86 on hv-cinder-81914 Jul 04 09:15:20.737734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-55ab87a5-a74e-410b-b38f-86833da9e8c3 req-fd1a4f4d-2fcd-4ba1-89c8-6f2fa9d45642 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149302 Jul 04 09:15:20.738372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 42/78] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:15:20.800487 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:20.801100 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:20.807309 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:20.807787 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:20.808552 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:20.808989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:20.960834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:20.974547 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-10a6f1e6-03a2-4f5f-99ef-4f9411acd241 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.177786 Jul 04 09:15:20.976411 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 37/79] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:20 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:21.054329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:21.055531 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:21.065917 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:21.068878 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:21.069875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:21.070488 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:21.301258 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:21.312868 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-917e60d1-e354-412d-a5f4-bf75bf93d5c2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.264571 Jul 04 09:15:21.325185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 43/80] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:21 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:21.355751 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:21.356431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:21.365262 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:21.367597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:21.368559 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:21.376779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:21.398005 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:21.608541 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:21.619021 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3be0950a-6c9a-4cff-b794-ca058e0b0656 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.267249 Jul 04 09:15:21.620302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 38/81] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:21 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:21.992344 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:21.992932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:21.999070 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:21.999479 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:22.000223 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:22.000699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:22.141445 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:22.159239 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2047f26e-a23c-45cd-83e4-9fe5b66b8684 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.170608 Jul 04 09:15:22.169502 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 44/82] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:21 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:22.332113 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:22.332734 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:22.340049 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:22.340504 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:22.341273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:22.341708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:22.486788 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:22.498664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b0dd2d36-d4ff-486c-9d02-5b302e3e47d9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.170402 Jul 04 09:15:22.500008 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 39/83] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:22 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:22.636919 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:22.637520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:22.643658 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:22.644278 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:22.645228 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:22.645803 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:22.818289 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:22.827342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b4b17f68-de50-433f-8bff-b437759a7486 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.194529 Jul 04 09:15:22.834898 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 45/84] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:22 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:23.177236 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:23.178256 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:23.184994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:23.185691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:23.187111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:23.187780 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:23.333136 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:23.341280 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-796ffe0a-b904-4016-bf50-baed5a9ea122 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.168157 Jul 04 09:15:23.342071 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:23 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:23.516718 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:23.517337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:23.523727 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:23.524166 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:23.524937 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:23.525357 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:23.684424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:23.697923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-48543ee5-7169-4176-a7fd-1b220dacc15e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.185765 Jul 04 09:15:23.699438 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 46/86] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:23 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:23.844775 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:23.845385 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:23.851705 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:23.852143 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:23.852894 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:23.853316 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:23.996619 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:24.004211 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-97596e0d-733b-4e95-b826-d30bca552048 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.163248 Jul 04 09:15:24.004788 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:23 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:24.359064 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:24.359692 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:24.361704 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:24.367482 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:24.367939 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:24.368718 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:24.369146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:24.509547 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:24.517453 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-812b180d-7e1b-431e-97dd-97aa38636b37 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.162877 Jul 04 09:15:24.518084 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 47/88] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:24 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:24.719253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:24.720092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:24.728553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:24.729091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:24.730316 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:24.730759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:24.863514 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:24.871011 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bbbbbf67-8003-4b49-85f6-a5d77cf82841 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.158132 Jul 04 09:15:24.871596 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 42/89] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:24 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:25.025534 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:25.026376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:25.036467 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:25.037322 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:25.038703 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:25.039624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:25.175402 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:25.183215 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1818cd86-b41c-4bf7-b05b-5724fc8ff05f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.163788 Jul 04 09:15:25.183786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 48/90] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:25 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:25.535908 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:25.536607 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:25.538695 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=8 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:25.544879 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:25.545442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:25.546258 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:25.546760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:25.684454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:25.692424 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-329dbe20-1d12-4728-96cb-561a965d5040 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.160722 Jul 04 09:15:25.693004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 43/91] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:25 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:25.890602 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:25.891250 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:25.898607 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:25.899080 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:25.899912 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:25.900379 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:26.204540 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:26.205092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:26.211410 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:26.211856 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:26.212625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:26.213139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:26.357985 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:26.365461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9325e678-ce5d-4d0b-8bc1-f6d5610d1f1d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.479446 Jul 04 09:15:26.366052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 49/92] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:25 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:26.393802 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:26.401422 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-31dd769d-2bdb-49de-98bd-e201495604eb tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.200953 Jul 04 09:15:26.402005 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 44/93] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:26 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:26.710137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:26.711180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:26.717712 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:26.718166 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:26.719095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:26.719738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:26.874563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:26.887203 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a45d9c8c-82d1-434b-bf60-c36e7512970a tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.180607 Jul 04 09:15:26.888370 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 50/94] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:26 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:27.382680 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:27.383299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:27.391286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:27.391733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:27.392494 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:27.392931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:27.419218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:27.419814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:27.426512 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:27.426968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:27.427730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:27.428161 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:27.633283 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:27.641606 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cba6ddfe-e843-4266-be1d-78245ab923b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.262806 Jul 04 09:15:27.641909 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:27.642223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 45/95] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:27 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:27.650679 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6e15f1ec-4a7b-4410-9752-83f6c5f38eb0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.236028 Jul 04 09:15:27.651295 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 51/96] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:27 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:27.907873 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:27.908595 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:27.917264 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:27.917705 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:27.918509 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:27.919248 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:28.073072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:28.081398 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6e2b60a6-becb-4c6e-a593-8d7d4cb0d46c tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.180091 Jul 04 09:15:28.082015 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 46/97] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:27 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:28.663509 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:28.664652 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:28.672191 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:28.672805 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:28.674626 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:28.675126 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:28.675947 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:28.676431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:28.678930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:28.679309 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:28.680057 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:28.680480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:29.064695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:29.073230 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4042c437-8704-418a-9ac8-e3113468095d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.416092 Jul 04 09:15:29.073818 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 52/98] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:28 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:29.086095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:29.102051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:29.103331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:29.105667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-579b0eae-f881-44c6-81f2-a0623f60e045 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.439246 Jul 04 09:15:29.106890 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:28 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:29.114523 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:29.117251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:29.120703 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:29.121476 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:29.455157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:29.462809 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-134c4997-205a-4241-9269-a77c4e106860 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.367627 Jul 04 09:15:29.463389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 53/100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:29 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:30.091097 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:30.091709 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:30.098128 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:30.098575 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:30.099334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:30.099766 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:30.123645 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:30.124540 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:30.126828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:30.132642 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:30.133288 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:30.134826 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:30.135443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:30.312841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:30.323725 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5065975e-c9fa-4924-9bd0-526220d7e8b2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.236303 Jul 04 09:15:30.324331 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 48/101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:30 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:30.338616 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:30.346923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3c88280b-490f-4a61-ad31-82b0c1dfeec0 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.227396 Jul 04 09:15:30.347496 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 54/102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:30 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:30.482132 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:30.482926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:30.490502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:30.490946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:30.492045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:30.492648 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:30.625694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:30.634083 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-196e561d-caff-4af7-a95f-59731f95048e tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.157518 Jul 04 09:15:30.634653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 49/103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:30 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:31.345232 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:31.345918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:31.352324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:31.352869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:31.353702 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:31.354229 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:31.364140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:31.364728 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:31.375672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:31.376126 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:31.376901 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:31.377339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:31.539650 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:31.548047 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0689bd58-340f-44ef-9e80-f3ea566e0a66 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.209180 Jul 04 09:15:31.549173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 55/104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:31 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:31.563917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:31.571737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3eca81bb-6a3f-4a61-aef9-45d2ddab15dd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.212075 Jul 04 09:15:31.572372 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 50/105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:31 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:31.654926 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:31.656141 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:31.665840 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:31.666670 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:31.668469 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:31.669184 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:31.804620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:31.812516 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f2edc439-00b3-4972-a4d3-fb2d620e9c90 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.163902 Jul 04 09:15:31.813113 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 56/106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:31 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:32.564582 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:32.565481 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:32.572061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:32.572804 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:32.573419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:32.573906 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:32.588832 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:32.590158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:32.597538 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:32.598514 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:32.599411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:32.600478 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:32.947700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:32.957196 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-df306f0e-2d26-422d-889f-64e3d2d1456e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.396454 Jul 04 09:15:32.966586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 51/107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:32 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:32.966586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:32.966586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:32.970978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:32.971405 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:32.972166 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:32.972700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:32.974410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:32.981971 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4bd4f7e4-abff-4ef6-b4c1-8333a130f45b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.397001 Jul 04 09:15:32.982605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 57/108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:32 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:33.108012 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:33.115683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-18c6ba62-42a5-4f52-84e6-e53691481a11 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.156715 Jul 04 09:15:33.116257 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 52/109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:32 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:33.974135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:33.975292 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:33.983750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:33.984448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:33.985398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:33.986139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:34.000876 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:34.001490 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:34.014899 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:34.015408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:34.018371 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:34.020560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:34.407659 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:34.411307 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=100 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:34.416222 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5a905030-1a68-45a1-8214-6b1062c6d20a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.446446 Jul 04 09:15:34.416955 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 58/110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:33 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:34.425438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:34.426865 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:34.427863 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:34.435606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:34.435871 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2d2f4739-6a76-48d3-ac8a-d50cb1f9d904 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.440397 Jul 04 09:15:34.436351 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:34.437265 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:34.437972 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:34.438798 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 53/111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:33 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:34.648150 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:34.663121 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-40c117ad-fa13-4aa5-80f3-ea5974445173 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.239149 Jul 04 09:15:34.664133 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 59/112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:34 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:35.434550 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:35.435172 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:35.443119 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:35.443768 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:35.445271 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:35.445718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:35.457538 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:35.458525 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:35.467319 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:35.469711 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:35.472556 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:35.473177 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:35.814575 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:35.816740 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:35.824295 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1af5ea6a-9334-4d11-89ce-fb07356c82ca tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.371458 Jul 04 09:15:35.827542 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9e56f512-1aad-4490-a2e9-4314c3bffcb3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.397808 Jul 04 09:15:35.830668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 54/113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:35 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:35.834043 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 60/114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:35 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:35.843951 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:35.846055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:35.854757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:35.855880 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:35.858288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:35.859025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:35.865458 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:36.034758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:36.044421 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ea13257d-92f9-45d3-b411-d52d5d64d98d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.209077 Jul 04 09:15:36.045741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 55/115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:35 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:36.840674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:36.842078 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:36.847291 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:36.849833 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:36.851854 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:36.853389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:36.854268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:36.854715 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:36.869355 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:36.870600 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:36.872396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:36.873998 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:37.103666 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:37.115585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2b08e89b-997d-4afa-b6f4-cfd2176722d6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.278616 Jul 04 09:15:37.127249 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 61/116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:36 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:37.132304 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:37.137019 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:37.137629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:37.145639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9a81bc6d-51ba-46e5-a9fb-27e06c172475 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.302524 Jul 04 09:15:37.146292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 56/117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:36 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:37.147135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:37.147577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:37.148663 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:37.149104 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:37.301855 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:37.309602 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b839148c-5cde-4292-b4a8-5dcabe9d054b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.188727 Jul 04 09:15:37.310223 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 62/118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:37 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:37.780344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e5006e6d-0ba6-4187-af44-d2e9cc1efa60 req-26adafc7-5c18-4fb3-97f0-7bf0190b3d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb12a448-abd1-4f71-a368-8e85bedaf38b", "name": "network-vif-plugged", "status": "completed", "tag": "4d51a8b6-0abd-4c35-b502-9d5ad3cc0c9d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:37.799029 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e5006e6d-0ba6-4187-af44-d2e9cc1efa60 req-26adafc7-5c18-4fb3-97f0-7bf0190b3d50 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:37.800239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e5006e6d-0ba6-4187-af44-d2e9cc1efa60 req-26adafc7-5c18-4fb3-97f0-7bf0190b3d50 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:37.819790 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e5006e6d-0ba6-4187-af44-d2e9cc1efa60 req-26adafc7-5c18-4fb3-97f0-7bf0190b3d50 service nova] Creating event network-vif-plugged:4d51a8b6-0abd-4c35-b502-9d5ad3cc0c9d for instance eb12a448-abd1-4f71-a368-8e85bedaf38b on hv-cinder-81914 Jul 04 09:15:37.829443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e5006e6d-0ba6-4187-af44-d2e9cc1efa60 req-26adafc7-5c18-4fb3-97f0-7bf0190b3d50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.501595 Jul 04 09:15:37.831558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 57/119] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:15:38.135762 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:38.136366 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:38.146155 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:38.146603 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:38.147369 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:38.147847 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:38.167973 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:38.168725 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:38.192220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:38.193343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:38.194494 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:38.194934 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:38.583031 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:38.601465 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-163e4e7c-d9cc-4550-8f71-1ac76b668e34 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.470427 Jul 04 09:15:38.606120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 63/120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:38 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:38.609126 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:38.617050 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9360449d-80ad-49be-9985-67cb888e9782 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.457640 Jul 04 09:15:38.617858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 58/121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:38 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:38.620483 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:38.621278 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:38.632072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:38.634651 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:38.638134 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:38.638758 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:38.947148 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:38.963166 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bc6e8779-47e3-411d-b9d6-d85408ad6b91 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.358299 Jul 04 09:15:38.964055 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 64/122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:38 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:39.618661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:39.619293 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:39.625608 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:39.626395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:39.627454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:39.627998 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:39.640321 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:39.641988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:39.665146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:39.666226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:39.668656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:39.669324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:39.935760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:39.948586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-04fc6a89-018c-413c-8be6-abe9205f2a7e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.333547 Jul 04 09:15:39.949592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 59/123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:39 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:39.956222 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-288544b4-9542-4488-9366-e9689b29b0a3 req-7764873e-e326-493f-824f-f783dcbb40e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b908667b-9eab-4249-b81a-acd8c6e40e86", "name": "network-vif-plugged", "status": "completed", "tag": "232e0862-e534-47a3-801c-2e64bb8cb2cf"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:39.975555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-288544b4-9542-4488-9366-e9689b29b0a3 req-7764873e-e326-493f-824f-f783dcbb40e4 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:39.976243 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-288544b4-9542-4488-9366-e9689b29b0a3 req-7764873e-e326-493f-824f-f783dcbb40e4 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:39.985823 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:39.994345 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7952fe9f-e375-4f7e-b10f-08c90fc2fed1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.363592 Jul 04 09:15:39.995687 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 65/124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:39 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:39.997830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-288544b4-9542-4488-9366-e9689b29b0a3 req-7764873e-e326-493f-824f-f783dcbb40e4 service nova] Creating event network-vif-plugged:232e0862-e534-47a3-801c-2e64bb8cb2cf for instance b908667b-9eab-4249-b81a-acd8c6e40e86 on hv-cinder-81914 Jul 04 09:15:40.000911 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:40.001800 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:40.004177 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-288544b4-9542-4488-9366-e9689b29b0a3 req-7764873e-e326-493f-824f-f783dcbb40e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052899 Jul 04 09:15:40.004825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 60/125] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:15:40.010013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:40.010645 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:40.022528 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:40.025074 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:40.332353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:40.342780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-99f5f99a-ec47-4b46-b9a7-04f5ec273317 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.345646 Jul 04 09:15:40.352679 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 66/126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:39 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:40.971716 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:40.973060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:40.979746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:40.980388 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:40.981470 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:40.982097 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:41.014279 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:41.015033 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:41.026908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:41.028118 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:41.033463 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:41.034351 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:41.287889 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:41.296635 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4d0d27d0-152f-40b6-9aeb-083c78f6eb8d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1361 microversion: 2.1 time: 0.330126 Jul 04 09:15:41.310945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 61/127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:40 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:41.313226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:41.322661 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-01e60e79-15bd-4364-8109-3db8d82fbecd tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.314091 Jul 04 09:15:41.323416 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 67/128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:41 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:41.361568 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:41.362500 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:41.376882 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:41.377717 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:41.379192 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:41.379774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:41.572111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:41.582997 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-71412b28-5de5-4476-abf2-bdce46c89503 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.226535 Jul 04 09:15:41.583911 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 62/129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:41 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:42.020877 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-14a254e5-9691-4009-b952-3415c6ed520b req-df5b708f-2d03-4d52-ad86-3751b0a1f1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf474beb-fb86-4571-a949-b4fde11c34db", "name": "network-vif-plugged", "status": "completed", "tag": "90432259-5748-4275-9dd4-31b28ac81966"}, {"server_uuid": "ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa", "name": "network-vif-plugged", "status": "completed", "tag": "e4032ca7-9968-41ab-84f4-ed9cfa71c82a"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:42.030494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-14a254e5-9691-4009-b952-3415c6ed520b req-df5b708f-2d03-4d52-ad86-3751b0a1f1ba service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.030662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-14a254e5-9691-4009-b952-3415c6ed520b req-df5b708f-2d03-4d52-ad86-3751b0a1f1ba service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.045591 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-14a254e5-9691-4009-b952-3415c6ed520b req-df5b708f-2d03-4d52-ad86-3751b0a1f1ba service nova] Creating event network-vif-plugged:90432259-5748-4275-9dd4-31b28ac81966 for instance bf474beb-fb86-4571-a949-b4fde11c34db on hv-cinder-81914 Jul 04 09:15:42.046129 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-14a254e5-9691-4009-b952-3415c6ed520b req-df5b708f-2d03-4d52-ad86-3751b0a1f1ba service nova] Creating event network-vif-plugged:e4032ca7-9968-41ab-84f4-ed9cfa71c82a for instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa on hv-cinder-81914 Jul 04 09:15:42.053538 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-14a254e5-9691-4009-b952-3415c6ed520b req-df5b708f-2d03-4d52-ad86-3751b0a1f1ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037024 Jul 04 09:15:42.054201 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 68/130] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:15:42.324888 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:42.325616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:42.356969 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:42.361399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:42.368038 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.374319 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.379402 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.388924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.398639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.399819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.401534 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.407046 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.741699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:42.755100 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-36823ae8-ea9f-4be4-a98b-862c5e4627ac tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1546 microversion: 2.1 time: 0.435497 Jul 04 09:15:42.756565 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 63/131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:42 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1546 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:42.770723 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:42.773778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:42.775805 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:42.783076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f9dfd335-2907-4098-a07b-52852e41aa0f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.445535 Jul 04 09:15:42.784493 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 69/132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:42 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:42.792511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.792962 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.793733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.797659 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f6120678-e1cf-40a9-85e1-9d72bd0aca7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:42.797853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.798785 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f6120678-e1cf-40a9-85e1-9d72bd0aca7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:42.808072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6120678-e1cf-40a9-85e1-9d72bd0aca7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.809366 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6120678-e1cf-40a9-85e1-9d72bd0aca7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:42.810591 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6120678-e1cf-40a9-85e1-9d72bd0aca7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:42.811659 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6120678-e1cf-40a9-85e1-9d72bd0aca7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:43.076468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:43.087692 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91c238d1-12d4-446d-b4f6-0e0b1503de4b tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.327326 Jul 04 09:15:43.100571 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 64/133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:42 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:43.105640 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f6120678-e1cf-40a9-85e1-9d72bd0aca7a tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319704 Jul 04 09:15:43.109948 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 70/134] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:15:42 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:15:43.800997 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:43.801991 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:43.808588 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:43.809039 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:43.809833 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:43.810295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:43.982968 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:43.993940 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e88a0bf0-00f9-4f9d-a59d-c858c2d68c8e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1321 microversion: 2.1 time: 0.195877 Jul 04 09:15:43.993940 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:43 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:44.105932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:44.106545 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:44.124874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:44.125416 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:44.129674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:44.132834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:44.391648 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:44.400077 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-74c4a250-2cc1-48e3-b158-20d3db93b909 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1315 microversion: 2.1 time: 0.297911 Jul 04 09:15:44.401938 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:44 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:44.743195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-5c1a6479-1f65-4927-be55-e3e14eb5e630 req-413b4698-1658-4c2b-8a2f-dbdfc631e7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b908667b-9eab-4249-b81a-acd8c6e40e86", "tag": "232e0862-e534-47a3-801c-2e64bb8cb2cf"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:44.762291 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-5c1a6479-1f65-4927-be55-e3e14eb5e630 req-413b4698-1658-4c2b-8a2f-dbdfc631e7a5 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:44.763407 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-5c1a6479-1f65-4927-be55-e3e14eb5e630 req-413b4698-1658-4c2b-8a2f-dbdfc631e7a5 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:44.782774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-5c1a6479-1f65-4927-be55-e3e14eb5e630 req-413b4698-1658-4c2b-8a2f-dbdfc631e7a5 service nova] Creating event network-changed:232e0862-e534-47a3-801c-2e64bb8cb2cf for instance b908667b-9eab-4249-b81a-acd8c6e40e86 on hv-cinder-81914 Jul 04 09:15:44.788981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-5c1a6479-1f65-4927-be55-e3e14eb5e630 req-413b4698-1658-4c2b-8a2f-dbdfc631e7a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053728 Jul 04 09:15:44.790317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 66/137] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:15:45.010554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:45.011490 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:45.022618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.023316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.024249 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.025558 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.225499 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:45.234664 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-12d72ea7-9a9a-45b5-9013-d45327f48e4a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1514 microversion: 2.1 time: 0.228645 Jul 04 09:15:45.235249 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 72/138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:45 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:45.253460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:45.255334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:45.274884 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.275337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.276124 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.276711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.351247 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lazy-loading 'flavor' on Instance uuid bf474beb-fb86-4571-a949-b4fde11c34db {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:15:45.417003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:45.420787 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:45.428250 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.428689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.429550 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.430051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.529369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9fa442b9-4446-449f-aa9e-375ba6598e00 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db/action" status: 200 len: 32 microversion: 2.1 time: 0.280357 Jul 04 09:15:45.530025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 67/139] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:15:45 2022] POST /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:15:45.545319 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:45.547647 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:45.563846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.566886 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.568725 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:45.571259 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:45.662879 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:45.676259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-34447b00-3995-4d9d-b611-06b4703374f4 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1502 microversion: 2.1 time: 0.262968 Jul 04 09:15:45.679230 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 73/140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:45 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:45.829724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:45.839136 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-52701c36-7a7f-4f64-ae82-b692b1bb0f68 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.301134 Jul 04 09:15:45.839978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 68/141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:45 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:46.857145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:46.857807 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:46.865220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:46.865661 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:46.866544 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:46.866932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:47.019904 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:47.028416 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3fd4973f-ce23-4820-a174-deedeedf548b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.175425 Jul 04 09:15:47.039116 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 74/142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:46 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:48.046522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:48.047136 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:48.060497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:48.060497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:48.060497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:48.060497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:48.220455 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:48.228919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b64a32df-843b-4971-8ec1-0574cf3f610d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.186773 Jul 04 09:15:48.229801 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:48 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:49.246996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:49.247592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:49.262251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:49.264381 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:49.265201 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:49.267183 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:49.358639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4c439c39-4ba6-4563-b10d-9f4885d84edc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8773798f-d466-4325-8005-bb53bf7720b1"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:15:49.360080 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4c439c39-4ba6-4563-b10d-9f4885d84edc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:49.390482 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c439c39-4ba6-4563-b10d-9f4885d84edc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:49.390971 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c439c39-4ba6-4563-b10d-9f4885d84edc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:49.393529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c439c39-4ba6-4563-b10d-9f4885d84edc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:49.400212 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c439c39-4ba6-4563-b10d-9f4885d84edc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:49.507624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:49.529983 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-aa09b547-2663-4ae0-9c6e-07d74b6e6ea5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.286793 Jul 04 09:15:49.530592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 75/144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:49 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:49.968539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:50.002858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4c439c39-4ba6-4563-b10d-9f4885d84edc tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "POST /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649215 Jul 04 09:15:50.003922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 70/145] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:15:49 2022] POST /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:15:50.547764 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:50.548448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:50.556364 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:50.557014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:50.559190 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:50.559923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:50.586179 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=100 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:50.759799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:50.768625 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c5901c14-ee0b-4395-b3a9-a2c8bdb30e7c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.225184 Jul 04 09:15:50.769214 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 76/146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:50 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:51.792644 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:51.796440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:51.800797 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=69 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:51.810281 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:51.814028 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:51.816182 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:51.816841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:52.248009 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:52.276139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-64102938-4054-4c80-ba09-03f2f6eda158 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.488947 Jul 04 09:15:52.287986 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 71/147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:51 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:53.297864 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:53.300678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:53.314302 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:53.315072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:53.316838 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:53.317426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:53.554076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:53.562399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f3371630-6544-478f-b480-5b3683f01e53 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.272217 Jul 04 09:15:53.572331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 77/148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:53 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:54.580342 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:54.582051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:54.589198 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:54.589646 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:54.590450 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:54.591049 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:54.734844 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:54.744853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8cc9d8a8-d930-4995-9104-c0e9dd01468b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.169166 Jul 04 09:15:54.745516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 72/149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:54 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:55.762217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:55.762829 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:55.766012 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=62 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:15:55.769877 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:55.770342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:55.771315 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:55.771894 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:55.923104 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:55.934353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1a194961-e5e5-466f-a7fc-6cda0057db48 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.177146 Jul 04 09:15:55.934923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 78/150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:55 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:56.951815 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:56.952558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:56.960003 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:56.960442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:56.961362 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:56.961796 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:57.105843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:57.113584 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-90a5ace2-5950-4b83-80ce-b7030b1c0ce0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.166150 Jul 04 09:15:57.114195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 73/151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:56 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:58.131294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:58.131942 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:58.141866 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:58.144606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:58.145452 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:58.149806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:58.321046 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:58.329141 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-caa2a7aa-1c4b-4e4e-97cc-d035ebb8130b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.202334 Jul 04 09:15:58.329739 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 79/152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:58 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:15:59.196176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:59.196686 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:59.203520 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:59.204143 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:59.205339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:59.206019 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:59.233559 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:15:59.341477 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-797553a1-2741-4f87-b6fa-e58170ce4d3d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 204 len: 0 microversion: 2.1 time: 0.148487 Jul 04 09:15:59.342811 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 74/153] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:15:59 2022] DELETE /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:15:59.348086 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:59.348797 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:59.352497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:15:59.353277 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:15:59.356910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:59.357370 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:59.358137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:59.358560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:59.360958 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:59.361556 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:59.362511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:15:59.363103 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:15:59.585000 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:59.590073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:15:59.594430 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-56c06691-33b3-4cbd-bcf9-31f1b34c8466 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.246917 Jul 04 09:15:59.595460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 75/154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:59 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:15:59.606913 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dc261742-7569-4a79-9e62-78f7c15d0e80 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.262811 Jul 04 09:15:59.607518 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 80/155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:15:59 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:00.615858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:00.616645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:00.625748 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:00.626504 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:00.627860 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:00.628506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:00.632319 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:00.633142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:00.642631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:00.643432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:00.644333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:00.645137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:00.881531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:00.887197 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:00.890804 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-66e2f320-d58b-41ee-91c3-b03e2b77db79 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.279442 Jul 04 09:16:00.891839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 76/156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:00 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:00.900155 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e17049af-0634-4e5b-8ce3-ba983a69717a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.279763 Jul 04 09:16:00.901269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 81/157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:00 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:01.909471 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:01.910235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:01.917152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:01.917592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:01.918013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:01.918471 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:01.918949 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:01.919989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:01.929058 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:01.930017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:01.931155 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:01.931775 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:02.158230 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:02.176247 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ba61ca0d-5a59-4d45-a5a9-6188e378c3e9 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.268761 Jul 04 09:16:02.176876 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 77/158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:01 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:02.195409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:02.203966 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c8568481-52fa-4831-8b6e-3e1aa54d678a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.290239 Jul 04 09:16:02.213386 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 82/159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:01 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:03.194239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:03.197194 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:03.223831 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:03.225103 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:03.235548 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:03.238639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:03.243057 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:03.243370 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:03.247636 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:03.248364 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:03.249844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:03.251643 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:03.522926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:03.539176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-98a49973-812d-46e1-acbf-2a7bd1b01dfb tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.350401 Jul 04 09:16:03.540308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:03 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:03.579321 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:03.592429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-30bb2df0-e938-4013-a9ea-e8b23b6caae4 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.373300 Jul 04 09:16:03.593337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 83/161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:03 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:04.558129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:04.559314 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:04.569026 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:04.571298 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:04.572811 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:04.575385 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:04.621426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:04.622626 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:04.637689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:04.638173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:04.640089 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:04.640863 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:05.115259 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:05.132942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-783d4d25-b74f-4ce3-8366-7c753f00ed50 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.579370 Jul 04 09:16:05.143676 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 79/162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:04 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:05.143945 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:05.149614 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-6bbc665f-4eea-4f22-b472-3e26ae0ec788 req-d7b4891a-9d6d-4a26-a8fb-6fa4970d1af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa", "name": "network-vif-unplugged", "status": "completed", "tag": "e4032ca7-9968-41ab-84f4-ed9cfa71c82a"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:05.159356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-82d8f530-7ad2-427a-8e9f-1c6dcb64983a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.553200 Jul 04 09:16:05.160188 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 84/163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:04 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:05.165436 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6bbc665f-4eea-4f22-b472-3e26ae0ec788 req-d7b4891a-9d6d-4a26-a8fb-6fa4970d1af2 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:05.165873 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6bbc665f-4eea-4f22-b472-3e26ae0ec788 req-d7b4891a-9d6d-4a26-a8fb-6fa4970d1af2 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:05.182599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-6bbc665f-4eea-4f22-b472-3e26ae0ec788 req-d7b4891a-9d6d-4a26-a8fb-6fa4970d1af2 service nova] Creating event network-vif-unplugged:e4032ca7-9968-41ab-84f4-ed9cfa71c82a for instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa on hv-cinder-81914 Jul 04 09:16:05.189166 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-6bbc665f-4eea-4f22-b472-3e26ae0ec788 req-d7b4891a-9d6d-4a26-a8fb-6fa4970d1af2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043782 Jul 04 09:16:05.195170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 80/164] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:06.159502 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:06.160478 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:06.185624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:06.186608 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:06.193732 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:06.200073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:06.202775 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:06.204754 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:06.207184 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:06.210506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:06.217337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:06.218088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:06.806716 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:06.836425 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-820508d3-680b-4040-9f22-d26b61669a77 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.657694 Jul 04 09:16:06.852661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 81/165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:06 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:06.868552 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:06.879859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-20dd9b5f-d5b5-49dd-ba94-ab79304b7073 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.732968 Jul 04 09:16:06.881085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 85/166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:06 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:07.859839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:07.860452 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:07.883615 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:07.886718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:07.889701 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:07.891134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:07.902174 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:07.902174 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:07.919295 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:07.919765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:07.920533 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:07.926801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:08.434509 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:08.435186 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:08.476983 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0604b7c2-dfff-452c-b599-4964d5d1a196 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.583618 Jul 04 09:16:08.479216 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-20d3622f-508f-46ca-ad03-b0b305faa625 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.623911 Jul 04 09:16:08.499777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 82/167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:07 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:08.499870 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 86/168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:07 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:09.510876 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:09.512597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:09.513113 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:09.514579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:09.532567 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:09.534015 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:09.534492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:09.535344 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:09.535765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:09.536230 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:09.537063 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:09.537809 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:10.052262 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:10.065853 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:10.068106 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4a591d7c-f598-46f1-8ce9-07480448058f tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1554 microversion: 2.1 time: 0.564987 Jul 04 09:16:10.069159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 83/169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:09 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1554 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:10.084458 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-aa54c5cc-0312-495f-b91b-f16b1608bdc8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.572956 Jul 04 09:16:10.085398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 87/170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:09 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:10.535295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-5ee9e680-f58d-416a-8184-4a3edc56d016 req-3e72d3f8-7369-4b73-8480-3db5cf590ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa", "name": "network-vif-deleted", "tag": "e4032ca7-9968-41ab-84f4-ed9cfa71c82a"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:10.561729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-5ee9e680-f58d-416a-8184-4a3edc56d016 req-3e72d3f8-7369-4b73-8480-3db5cf590ef6 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:10.564192 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-5ee9e680-f58d-416a-8184-4a3edc56d016 req-3e72d3f8-7369-4b73-8480-3db5cf590ef6 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:10.600839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-5ee9e680-f58d-416a-8184-4a3edc56d016 req-3e72d3f8-7369-4b73-8480-3db5cf590ef6 service nova] Creating event network-vif-deleted:e4032ca7-9968-41ab-84f4-ed9cfa71c82a for instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa on hv-cinder-81914 Jul 04 09:16:10.615480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-5ee9e680-f58d-416a-8184-4a3edc56d016 req-3e72d3f8-7369-4b73-8480-3db5cf590ef6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083059 Jul 04 09:16:10.617057 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 84/171] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:16:11.086438 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:11.091520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:11.106433 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:11.108107 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:11.129782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:11.129782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:11.133604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:11.137872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:11.139498 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:11.140727 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:11.142273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:11.143921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:11.390249 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99f1e73a214b4ab32102a9ab5670fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c95b6f91e84cd498cc57c55253a477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:11.415027 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-afab8701-83b7-446c-bd8b-757ad1e0b3a3 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 200 len: 1346 microversion: 2.1 time: 0.321185 Jul 04 09:16:11.416800 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 88/172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:11 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 1346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:11.706255 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:11.722866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6f467449-099e-43e1-a594-d29a71ed45a8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.623186 Jul 04 09:16:11.726679 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 85/173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:11 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:12.443147 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:12.445311 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:12.455213 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:12.455614 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:12.461349 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:12.461865 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:12.485278 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] HTTP exception thrown: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Request method failure captured: Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa HTTP/1.1 Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-RngwtQ5bxf4ylBpUx9I-o88rKItdwqi_HGO6XFY8tUsH58rSvOhDl2Km94Up-_tuUKFnABg3xgRT_6bfUb1BamT0SC6tV_zy6wPa4j_CEfu6D_d0tBVmN1zDhW-5gT9j2s9QqALiBRNG184XKaWbUzB7BOl7Fuhj3edpijwguJco Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:16:12.490734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13c95b6f91e84cd498cc57c55253a477", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13c95b6f91e84cd498cc57c55253a477"}]}] Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: cb99f1e73a214b4ab32102a9ab5670fb Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.492170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa'} Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:16:12.492845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.494066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.496561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Returning 404 to user: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:16:12.497680 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0c486297-c49e-4bb3-ab9d-a0e470e4539d tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 404 len: 111 microversion: 2.1 time: 0.067597 Jul 04 09:16:12.498532 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 89/174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:12 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:16:12.626228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:12.628192 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:12.666713 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:12.669434 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:12.670390 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:12.671261 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:12.713072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] HTTP exception thrown: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Request method failure captured: Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa/os-volume_attachments HTTP/1.1 Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-RngwtQ5bxf4ylBpUx9I-o88rKItdwqi_HGO6XFY8tUsH58rSvOhDl2Km94Up-_tuUKFnABg3xgRT_6bfUb1BamT0SC6tV_zy6wPa4j_CEfu6D_d0tBVmN1zDhW-5gT9j2s9QqALiBRNG184XKaWbUzB7BOl7Fuhj3edpijwguJco Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:16:12.727883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13c95b6f91e84cd498cc57c55253a477", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13c95b6f91e84cd498cc57c55253a477"}]}] Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: cb99f1e73a214b4ab32102a9ab5670fb Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.730234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'server_id': 'ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa'} Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:16:12.730956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:12.732051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:12.733220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Returning 404 to user: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:16:12.733220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-de6eb6f6-f29a-4eff-8b18-4d91d890ec24 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.109752 Jul 04 09:16:12.738074 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 86/175] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:16:12 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa/os-volume_attachments => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:16:12.743269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:12.743891 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:12.756122 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:12.756906 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:12.758051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:12.760789 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:13.075647 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:13.088392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-eb4aa62d-914c-432f-939f-afaa331f584e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.348623 Jul 04 09:16:13.098491 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 90/176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:12 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:13.704631 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-794079154", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "networks": [{"uuid": "bbd0766b-abd4-4629-88c9-33da6bb68597"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:13.803987 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] validate_networks() for [('bbd0766b-abd4-4629-88c9-33da6bb68597', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:16:14.062793 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:14.063294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:14.078653 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.079098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:14.079874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.080304 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:14.109611 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] HTTP exception thrown: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Request method failure captured: Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: DELETE /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa HTTP/1.1 Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-RngwtQ5bxf4ylBpUx9I-o88rKItdwqi_HGO6XFY8tUsH58rSvOhDl2Km94Up-_tuUKFnABg3xgRT_6bfUb1BamT0SC6tV_zy6wPa4j_CEfu6D_d0tBVmN1zDhW-5gT9j2s9QqALiBRNG184XKaWbUzB7BOl7Fuhj3edpijwguJco Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:16:14.111199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13c95b6f91e84cd498cc57c55253a477", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13c95b6f91e84cd498cc57c55253a477"}]}] Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: cb99f1e73a214b4ab32102a9ab5670fb Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.112716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa'} Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:16:14.113536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.114860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.119013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Returning 404 to user: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:16:14.119890 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e629abce-3d92-4ca9-9e3c-fc5365fcaf86 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 404 len: 111 microversion: 2.1 time: 0.061095 Jul 04 09:16:14.122814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 91/177] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:16:14 2022] DELETE /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:16:14.129341 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:14.130249 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:14.149270 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.150067 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:14.159858 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.160482 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:14.557161 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:14.567833 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1f11878e-5ee8-4373-9615-0f1248481de9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.443914 Jul 04 09:16:14.569594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 92/178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:14 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:14.587353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:14.589443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] [instance: ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:14.611548 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.615260 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:14.616163 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.620394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:14.654134 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] HTTP exception thrown: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Request method failure captured: Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa HTTP/1.1 Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-RngwtQ5bxf4ylBpUx9I-o88rKItdwqi_HGO6XFY8tUsH58rSvOhDl2Km94Up-_tuUKFnABg3xgRT_6bfUb1BamT0SC6tV_zy6wPa4j_CEfu6D_d0tBVmN1zDhW-5gT9j2s9QqALiBRNG184XKaWbUzB7BOl7Fuhj3edpijwguJco Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:16:14.655880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13c95b6f91e84cd498cc57c55253a477", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c95b6f91e84cd498cc57c55253a477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13c95b6f91e84cd498cc57c55253a477"}]}] Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 13c95b6f91e84cd498cc57c55253a477 Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136642343 Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: cb99f1e73a214b4ab32102a9ab5670fb Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-DeleteServersTestJSON-1136642343-project Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.657073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa'} Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:16:14.657786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. Jul 04 09:16:14.659521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:16:14.660530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] Returning 404 to user: Instance ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:16:14.660530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8c9f42aa-1976-4b59-a7ed-cae60e94d0c0 tempest-DeleteServersTestJSON-1136642343 tempest-DeleteServersTestJSON-1136642343-project] 10.222.0.26 "GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa" status: 404 len: 111 microversion: 2.1 time: 0.085011 Jul 04 09:16:14.660530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 93/179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:14 2022] GET /compute/v2.1/servers/ce2d6e48-fcd2-4c53-97a5-539ac72ed7aa => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:16:14.920707 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:16:14.921763 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:16:14.922486 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:16:14.923085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:16:14.923691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:16:14.950977 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.953219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:14.956248 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:14.959481 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:15.025666 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Getting quotas for project b7869946a7ac4ac7a15fab3dfe687abd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:16:15.035689 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Getting quotas for user 34edc297b377425b92683fc6530e8135 and project b7869946a7ac4ac7a15fab3dfe687abd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:16:15.074039 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:16:15.078846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:16:15.177512 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e9e12455-6cf5-48d6-a3f3-df484d86f0cb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.477939 Jul 04 09:16:15.182717 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 87/180] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:16:15.212454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-22862c52-144b-4ea8-b4a8-c10c4f5a77d4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:15.213206 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-22862c52-144b-4ea8-b4a8-c10c4f5a77d4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:15.440998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-22862c52-144b-4ea8-b4a8-c10c4f5a77d4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:15.454410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-22862c52-144b-4ea8-b4a8-c10c4f5a77d4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1213 microversion: 2.1 time: 0.256907 Jul 04 09:16:15.454994 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 94/181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:15 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:15.587636 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:15.590317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:15.608203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:15.608777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:15.610715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:15.611208 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:15.624957 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:16.473109 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:16.473776 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:16.485185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:16.487325 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:16.489421 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:16.489869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:16.659831 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:16.679115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-efb0ed47-6b69-4fdc-909c-8c2e3b028559 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 1.097141 Jul 04 09:16:16.690655 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 88/182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:15 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:16.731752 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:16.742844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a5afd0fe-2eb0-40fb-93c0-77b8358e7776 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1209 microversion: 2.1 time: 0.274879 Jul 04 09:16:16.743424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 95/183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:16 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1209 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:17.697241 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:17.697855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:17.708885 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:17.710383 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:17.711174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:17.711612 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:17.774219 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:17.774979 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:17.787132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:17.788059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:17.789107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:17.792568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:17.837091 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=100 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:18.125536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:18.145610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8846c710-fdfb-4d87-85bd-86efee4f87b3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1209 microversion: 2.1 time: 0.376387 Jul 04 09:16:18.164054 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 96/184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:17 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1209 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:18.435622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:18.445759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b5799806-f0c4-4eea-a2b5-3de1be089d9d tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.752890 Jul 04 09:16:18.455653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 89/185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:17 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:19.024482 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-37c4ca2f-6282-4bdb-8db7-85dca847bebd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Action: 'create', calling method: .version_select at 0x7f8e81bb2e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1158946767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhDIsX0PybxGk29ox9NHXUIc4iQw/GQ5I2Eyo8crGAi4PwAFvTvUAixRCwWUGKHK7Iffp/7J3UIKCU8NHeZ2e1JPljBu7O9LHJh/qwg+OkoRcQjqTRI1ZWfst7WNsaVbw=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:19.079852 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-37c4ca2f-6282-4bdb-8db7-85dca847bebd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Getting quotas for project 33b3e0ba3aa644ddbbee8f56be21ad06. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:16:19.091687 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-37c4ca2f-6282-4bdb-8db7-85dca847bebd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Getting quotas for user 5ba79c77fcd54bbcb673a5cba1ed2975 and project 33b3e0ba3aa644ddbbee8f56be21ad06. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:16:19.177322 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:19.179330 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:19.191945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:19.193566 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:19.195545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:19.196163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:19.203502 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-37c4ca2f-6282-4bdb-8db7-85dca847bebd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.472250 Jul 04 09:16:19.206515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 97/186] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:16:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:19.376835 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:19.390305 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5704a2a1-e78e-45c4-a556-f2e41c0824ec tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1265 microversion: 2.1 time: 0.229585 Jul 04 09:16:19.390947 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 90/187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:19 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:19.463218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:19.463925 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:19.486906 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:19.488925 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:19.490307 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:19.499104 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:19.845033 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:19.854408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-672b3452-c689-4f34-8c4f-53668ca5a6d2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.395245 Jul 04 09:16:19.855509 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 98/188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:19 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:20.408057 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:20.408862 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:20.415909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:20.416433 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:20.417669 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:20.418330 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:20.525178 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:20.534783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e612a969-1023-4f10-b366-104a494b3f56 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1271 microversion: 2.1 time: 0.130655 Jul 04 09:16:20.535753 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 91/189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:20 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:20.873946 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:20.874891 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:20.893269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:20.894660 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:20.897939 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:20.898973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:21.266795 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:21.278035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2a0b2f26-0f00-4c04-8519-ab086803d3af tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.410381 Jul 04 09:16:21.280339 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 99/190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:20 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:21.551926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:21.553829 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:21.568839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:21.569316 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:21.570183 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:21.570622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:21.737391 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:21.748683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be90d02d-ef4b-4db0-ad5e-9e4903be90ea tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1271 microversion: 2.1 time: 0.198212 Jul 04 09:16:21.749955 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 92/191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:21 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:22.296283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:22.297534 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:22.311507 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:22.311954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:22.312911 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:22.313843 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:22.713979 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:22.722454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e1a1e150-01f5-45f3-bebc-2a2e0347e4fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.430157 Jul 04 09:16:22.742587 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 100/192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:22 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:22.768849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:22.770182 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:22.783691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:22.788928 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:22.790735 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:22.792259 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:22.794096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:23.147957 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:23.165221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2cd714c2-e01f-423d-8aa4-a7c186cfc07b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.401237 Jul 04 09:16:23.175363 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 93/193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:22 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:23.749052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:23.749668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:23.760088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:23.760553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:23.763993 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:23.764454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:24.126366 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:24.134945 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0253a94d-9964-4cfa-bd8c-4c17dbf334e2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1520 microversion: 2.1 time: 0.390088 Jul 04 09:16:24.135551 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 101/194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:23 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:24.182814 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:24.183953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:24.192253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:24.193068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:24.194133 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:24.194733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:24.412216 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:24.424290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-61ba1096-178e-4822-996f-32d6de299418 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.242866 Jul 04 09:16:24.424703 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 94/195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:24 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:24.815067 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-d508f3ab-7ca9-44e0-822e-5852d9d9c9a1 req-83356cae-4ec9-4a75-a79c-07b4a1c634dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8954f3ab-7a8d-489d-b443-4bbde588ccb5", "tag": "54388153-9494-43cc-9dbf-141cabf26754"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:24.828758 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-d508f3ab-7ca9-44e0-822e-5852d9d9c9a1 req-83356cae-4ec9-4a75-a79c-07b4a1c634dc service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:24.829427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-d508f3ab-7ca9-44e0-822e-5852d9d9c9a1 req-83356cae-4ec9-4a75-a79c-07b4a1c634dc service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:24.843186 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-d508f3ab-7ca9-44e0-822e-5852d9d9c9a1 req-83356cae-4ec9-4a75-a79c-07b4a1c634dc service nova] Creating event network-changed:54388153-9494-43cc-9dbf-141cabf26754 for instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 on hv-cinder-81914 Jul 04 09:16:24.849286 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-d508f3ab-7ca9-44e0-822e-5852d9d9c9a1 req-83356cae-4ec9-4a75-a79c-07b4a1c634dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040244 Jul 04 09:16:24.850558 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 102/196] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:25.166988 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:25.167805 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:25.172791 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:25.173622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:25.176144 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:25.176975 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:25.178160 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:25.178739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:25.329738 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:25.344336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-82691866-a9ef-4963-a630-fcd8bdd96fb2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1500 microversion: 2.1 time: 0.195549 Jul 04 09:16:25.345034 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 95/197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:25 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:25.365133 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:25.365922 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:25.374990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:25.375578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:25.376461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:25.377314 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:25.467948 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:25.469047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:25.480535 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:25.481133 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:25.482485 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:25.483008 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:25.615068 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:25.623445 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7227abae-2b92-4330-bbcb-10d3535493f6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1514 microversion: 2.1 time: 0.263325 Jul 04 09:16:25.629385 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 103/198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:25 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:25.748813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:25.760290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-551203db-0a8d-46ad-aa3b-d6ae01798a7c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.308138 Jul 04 09:16:25.773796 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 96/199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:25 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:26.777591 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:26.778232 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:26.780335 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:26.786752 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:26.787226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:26.788225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:26.788662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:26.935127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:26.943377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8d4c3bab-383f-4753-9490-9312bdb43e91 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.169834 Jul 04 09:16:26.943939 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 104/200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:26 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:27.364676 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:27.365729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:27.376223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:27.378391 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:27.379206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:27.379646 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:27.407908 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lazy-loading 'flavor' on Instance uuid eb12a448-abd1-4f71-a368-8e85bedaf38b {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:16:27.516820 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b64763e2-04c9-41e3-b2ba-62f3ee618eb9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b/action" status: 200 len: 32 microversion: 2.1 time: 0.160000 Jul 04 09:16:27.518039 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 97/201] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:16:27 2022] POST /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:16:27.527397 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:27.528094 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:27.535793 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:27.536581 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:27.537428 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:27.537964 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:27.962691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:27.963830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:27.966542 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:27.975276 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:27.975950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4ec08add-40db-4ffb-990f-06207aaaba83 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.452381 Jul 04 09:16:27.976992 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:27.977094 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 105/202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:27 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:27.978292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:27.980924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:28.202454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:28.217753 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f239858-b69b-4448-a9fa-072ab46aad65 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.260724 Jul 04 09:16:28.220494 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 98/203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:27 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:28.993008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:28.993703 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:29.000915 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:29.001428 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:29.002778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:29.003275 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:29.113974 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:29.172729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:29.183539 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-eec2eb2c-9d19-46f2-85ff-bcfbed691763 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.194459 Jul 04 09:16:29.188935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 106/204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:28 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:29.237086 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:29.237853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:29.244864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:29.245306 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:29.246117 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:29.246539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:29.406435 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:29.414685 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cb5b569c-461a-42ee-834a-aec25e2e0791 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.181340 Jul 04 09:16:29.415063 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 99/205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:29 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:30.219942 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:30.220673 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:30.227660 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:30.228377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:30.230093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:30.230747 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:30.404374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:30.412359 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ae78dedb-abc2-4c47-9d25-e05deb988bd9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.197387 Jul 04 09:16:30.412975 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 107/206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:30 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:30.432534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:30.433136 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:30.439852 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:30.440285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:30.441037 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:30.441638 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:30.603381 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:30.611083 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c92bffcf-2ea9-4aec-a3c8-a4f5d1903ccb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.182467 Jul 04 09:16:30.611697 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 100/207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:30 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:31.431154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:31.431801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:31.438658 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:31.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:31.440647 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:31.441253 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:31.596305 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:31.604778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-86e96833-5ff7-4356-8b35-cb0f4a62f6f9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.177645 Jul 04 09:16:31.605415 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 108/208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:31 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:31.627287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:31.628000 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:31.647707 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:31.648286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:31.649131 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:31.649568 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:31.690383 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-95381c25-c99e-4f45-bdaa-35eb3423e9e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:31.692074 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-95381c25-c99e-4f45-bdaa-35eb3423e9e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:31.701339 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95381c25-c99e-4f45-bdaa-35eb3423e9e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:31.702293 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95381c25-c99e-4f45-bdaa-35eb3423e9e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:31.703345 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95381c25-c99e-4f45-bdaa-35eb3423e9e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:31.704446 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95381c25-c99e-4f45-bdaa-35eb3423e9e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:31.732348 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-95381c25-c99e-4f45-bdaa-35eb3423e9e9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/ips" status: 200 len: 144 microversion: 2.1 time: 0.047977 Jul 04 09:16:31.732937 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 109/209] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:16:31 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/ips => generated 144 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:16:31.885627 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:31.894362 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b6b85d3c-9926-4587-a986-37b9f803f42c tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.270814 Jul 04 09:16:31.895513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 101/210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:31 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:32.622437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:32.623072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:32.636758 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:32.638451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:32.639516 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:32.640119 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:32.806743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:32.816204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ea9a993c-e475-425a-9709-158186686f31 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.197596 Jul 04 09:16:32.816861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 110/211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:32 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:32.912341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:32.912850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:32.925257 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:32.925726 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:32.926882 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:32.927318 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:33.078786 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:33.085064 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:33.090447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0d9b823-7563-4a16-8831-254594458ed3 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.182363 Jul 04 09:16:33.092959 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 102/212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:32 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:33.387077 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-cabf7b96-7356-42ab-b071-6ad8f55d07af req-177352f6-2439-4aa9-b6ac-e3c3cd4a759f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8954f3ab-7a8d-489d-b443-4bbde588ccb5", "name": "network-vif-plugged", "status": "completed", "tag": "54388153-9494-43cc-9dbf-141cabf26754"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:33.396400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-cabf7b96-7356-42ab-b071-6ad8f55d07af req-177352f6-2439-4aa9-b6ac-e3c3cd4a759f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:33.396833 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-cabf7b96-7356-42ab-b071-6ad8f55d07af req-177352f6-2439-4aa9-b6ac-e3c3cd4a759f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:33.410036 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-cabf7b96-7356-42ab-b071-6ad8f55d07af req-177352f6-2439-4aa9-b6ac-e3c3cd4a759f service nova] Creating event network-vif-plugged:54388153-9494-43cc-9dbf-141cabf26754 for instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 on hv-cinder-81914 Jul 04 09:16:33.426331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-cabf7b96-7356-42ab-b071-6ad8f55d07af req-177352f6-2439-4aa9-b6ac-e3c3cd4a759f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063969 Jul 04 09:16:33.426948 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 111/213] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:33.840235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:33.841105 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:33.851683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:33.852408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:33.854222 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:33.855027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:34.026836 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:34.035195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5c8366b7-3d4e-47ec-84ab-be2802c51823 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.204289 Jul 04 09:16:34.035906 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 103/214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:33 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:34.111064 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:34.112425 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:34.121737 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:34.122425 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:34.124147 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:34.124678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:34.309425 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:34.321046 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d793301e-20b2-4b84-9f22-6392c7592494 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.216014 Jul 04 09:16:34.322374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 112/215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:34 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:35.054538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:35.056491 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:35.068679 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:35.069809 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:35.070918 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:35.071830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:35.337075 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:35.339255 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:35.341230 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:35.345667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b3bcb803-b7ba-4f8a-884a-6e39e5e651c3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.296561 Jul 04 09:16:35.346512 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 104/216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:35 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:35.348413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:35.349018 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:35.350472 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:35.351049 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:35.628304 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:35.630675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a4264442-cca0-44a9-9569-44d4989e1110 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c2ed612-a0af-4359-9975-557537afdfab"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:35.631775 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a4264442-cca0-44a9-9569-44d4989e1110 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:35.638572 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-53455f23-e0f5-4202-a6ff-313b50c744fb tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1313 microversion: 2.1 time: 0.303356 Jul 04 09:16:35.639437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 113/217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:35 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:35.651124 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4264442-cca0-44a9-9569-44d4989e1110 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:35.651579 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4264442-cca0-44a9-9569-44d4989e1110 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:35.652700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4264442-cca0-44a9-9569-44d4989e1110 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:35.653128 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4264442-cca0-44a9-9569-44d4989e1110 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:36.012530 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a4264442-cca0-44a9-9569-44d4989e1110 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386255 Jul 04 09:16:36.013372 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 105/218] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:16:35 2022] POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:16:36.366481 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:36.367096 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:36.381580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:36.382051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:36.382812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:36.383288 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:36.533116 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:36.541233 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6d3229ac-2493-4a6e-8f82-c6a98bed3682 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.180938 Jul 04 09:16:36.542082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 114/219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:36 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:36.657382 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:36.658614 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:36.674022 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:36.674493 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:36.675384 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:36.675815 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:36.890216 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:36.900258 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a0287ab2-9f64-4c3b-b0b8-8505b7269811 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1498 microversion: 2.1 time: 0.247998 Jul 04 09:16:36.905281 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 106/220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:36 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:37.580115 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:37.581587 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:37.589944 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:37.590117 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:37.590932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:37.591392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:37.607334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:37.608162 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:37.612004 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=100 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:37.615499 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:37.615987 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:37.617112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:37.617786 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:37.745628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:37.755467 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-eb8aa11b-0804-45ce-8df3-8d97b0c9bf32 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.180441 Jul 04 09:16:37.756333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 115/221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:37 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:37.809258 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:16:37.917638 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-508532e8-e252-4da7-b60a-3fef8a1e1c85 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 204 len: 0 microversion: 2.1 time: 0.315339 Jul 04 09:16:37.918351 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 107/222] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:16:37 2022] DELETE /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:16:37.927229 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:37.927695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:37.934880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:37.935328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:37.936088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:37.936519 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:38.078429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:38.086429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6b6ec330-cce3-47f8-9523-998c7848eca0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1504 microversion: 2.1 time: 0.163872 Jul 04 09:16:38.087086 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 116/223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:37 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:38.502532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1670127906", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "networks": [{"uuid": "19ba341d-8995-4ffa-b7cd-bd7817720293"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:38.559640 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] validate_networks() for [('19ba341d-8995-4ffa-b7cd-bd7817720293', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:16:38.773208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:38.773774 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:38.780236 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:38.780622 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:38.781376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:38.781789 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:38.993523 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:39.000159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:16:39.000627 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:16:39.001014 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:16:39.001410 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:16:39.001809 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:16:39.008863 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-259d4ea9-bce3-48ee-a0b4-3c6f39c71d98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.239458 Jul 04 09:16:39.009436 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 117/224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:38 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:39.013263 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:39.013742 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:39.014573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:39.015009 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:39.033715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Getting quotas for project fec91e0c883943448c9d0e8d4d5e09ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:16:39.037930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Getting quotas for user c0ebb8aa3b7146e4a34a565969154f9a and project fec91e0c883943448c9d0e8d4d5e09ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:16:39.049445 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:16:39.051870 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:16:39.105963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:39.106959 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:39.108309 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fc17d010-ec30-4e86-a9cf-b55b3b0b167c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612197 Jul 04 09:16:39.108969 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 108/225] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:16:39.114819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:39.115520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:39.116706 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:39.117594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:39.120097 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1628881f-45e4-4691-bb80-4e4846505421 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:39.120762 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1628881f-45e4-4691-bb80-4e4846505421 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:39.208942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1628881f-45e4-4691-bb80-4e4846505421 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:39.218996 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1628881f-45e4-4691-bb80-4e4846505421 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1219 microversion: 2.1 time: 0.103078 Jul 04 09:16:39.220062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 109/226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:39 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:39.300983 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:39.312614 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-84b6e42c-0400-4fd2-975b-1f2e4c6a6af2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1504 microversion: 2.1 time: 0.210248 Jul 04 09:16:39.313308 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 118/227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:39 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:40.027200 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:40.027803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:40.036087 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:40.036553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:40.037364 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:40.037772 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:40.194438 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-cb658b91-9189-4f0f-8e80-86e60ae3bdc3 req-942ba4f2-6249-49e5-8994-14635de2e38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8954f3ab-7a8d-489d-b443-4bbde588ccb5", "name": "network-vif-deleted", "tag": "54388153-9494-43cc-9dbf-141cabf26754"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:40.205827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:40.215164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-cb658b91-9189-4f0f-8e80-86e60ae3bdc3 req-942ba4f2-6249-49e5-8994-14635de2e38f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:40.216014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-cb658b91-9189-4f0f-8e80-86e60ae3bdc3 req-942ba4f2-6249-49e5-8994-14635de2e38f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:40.217944 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7d76fc39-017f-4616-9f92-6cf78c035c8b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.192995 Jul 04 09:16:40.219715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 110/228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:40 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:40.233556 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-cb658b91-9189-4f0f-8e80-86e60ae3bdc3 req-942ba4f2-6249-49e5-8994-14635de2e38f service nova] Creating event network-vif-deleted:54388153-9494-43cc-9dbf-141cabf26754 for instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 on hv-cinder-81914 Jul 04 09:16:40.238690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:40.240069 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:40.241152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-cb658b91-9189-4f0f-8e80-86e60ae3bdc3 req-942ba4f2-6249-49e5-8994-14635de2e38f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050448 Jul 04 09:16:40.243435 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 119/229] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:16:40.256686 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:40.257850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:40.259076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:40.259791 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:40.330869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:40.331678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:40.344070 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:40.347231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:40.347999 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:40.350404 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:40.390968 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:40.404092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-05b5995b-4005-4bce-9b5b-fd0304ddc7fd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1279 microversion: 2.1 time: 0.170585 Jul 04 09:16:40.421833 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 111/230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:40 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:40.464022 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:40.474369 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c862da6f-44d1-435c-af6b-50fc5f5223ab tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 200 len: 1298 microversion: 2.1 time: 0.147631 Jul 04 09:16:40.475158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 120/231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:40 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:41.237104 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:41.238592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:41.245867 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:41.246366 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:41.247140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:41.247783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:41.391105 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:41.398970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ffcab307-eb0e-42f8-a983-0492d490fc90 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.165821 Jul 04 09:16:41.399748 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 112/232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:41 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:41.424516 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:41.425964 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:41.433500 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:41.434166 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:41.435163 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:41.436091 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:41.490739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:41.491354 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: 8954f3ab-7a8d-489d-b443-4bbde588ccb5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:41.499785 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:41.500233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:41.501007 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:41.501438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:41.521490 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] HTTP exception thrown: Instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 could not be found. Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Request method failure captured: Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 HTTP/1.1 Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq_bKcLqxSnk9xx9EcB8elvS3PhV8U2IdmMpxxsNzPKOlqDDi4ApV26fHbGnhzYDe_B-97vfWTXtnALCZr01tXkb5Cz8jEhVvFys-rXReeFrqnG9ajs2d0olaRdKMfnN6kW9ETxm3cjbuduQdhFC_jxExB9OS9f0oojfCFSgWhvlECs Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: b7869946a7ac4ac7a15fab3dfe687abd Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesActionsTest-1509157531 Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:16:41.523795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7869946a7ac4ac7a15fab3dfe687abd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7869946a7ac4ac7a15fab3dfe687abd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7869946a7ac4ac7a15fab3dfe687abd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7869946a7ac4ac7a15fab3dfe687abd"}]}] Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesActionsTest-1509157531 Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b7869946a7ac4ac7a15fab3dfe687abd Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesActionsTest-1509157531 Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesActionsTest-1509157531-project Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 34edc297b377425b92683fc6530e8135 Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesActionsTest-1509157531-project Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 could not be found. Jul 04 09:16:41.525170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': '8954f3ab-7a8d-489d-b443-4bbde588ccb5'} Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 could not be found. Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:16:41.525935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 could not be found. Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 could not be found. Jul 04 09:16:41.527408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:41.528593 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Returning 404 to user: Instance 8954f3ab-7a8d-489d-b443-4bbde588ccb5 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:16:41.528593 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-57296a88-e3bf-4dce-8778-17f478a1ae02 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5" status: 404 len: 111 microversion: 2.1 time: 0.038545 Jul 04 09:16:41.530002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 113/233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:41 2022] GET /compute/v2.1/servers/8954f3ab-7a8d-489d-b443-4bbde588ccb5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:16:41.658745 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:41.672918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5157c288-d2c2-46c7-9108-1fca06a53f31 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1319 microversion: 2.1 time: 0.252006 Jul 04 09:16:41.674229 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 121/234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:41 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:41.688861 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-736790902", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "networks": [{"uuid": "bbd0766b-abd4-4629-88c9-33da6bb68597"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:41.749572 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] validate_networks() for [('bbd0766b-abd4-4629-88c9-33da6bb68597', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:16:42.298778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-1b3a7e68-0b4d-4781-82ec-271822345aac req-6044bde6-e5c3-4d54-bbf7-82b1adb2edc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1cd838-20f2-4b96-9f17-c1382deb7479", "tag": "72947163-4128-451c-9a62-4c4564d8be60"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:42.310990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1b3a7e68-0b4d-4781-82ec-271822345aac req-6044bde6-e5c3-4d54-bbf7-82b1adb2edc2 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:42.311417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1b3a7e68-0b4d-4781-82ec-271822345aac req-6044bde6-e5c3-4d54-bbf7-82b1adb2edc2 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:42.323554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-1b3a7e68-0b4d-4781-82ec-271822345aac req-6044bde6-e5c3-4d54-bbf7-82b1adb2edc2 service nova] Creating event network-changed:72947163-4128-451c-9a62-4c4564d8be60 for instance bd1cd838-20f2-4b96-9f17-c1382deb7479 on hv-cinder-81914 Jul 04 09:16:42.328961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-1b3a7e68-0b4d-4781-82ec-271822345aac req-6044bde6-e5c3-4d54-bbf7-82b1adb2edc2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033958 Jul 04 09:16:42.330113 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 122/235] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:42.417357 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:42.418246 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:42.424958 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:42.425588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:42.426486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:42.427124 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:42.464008 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:16:42.464497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:16:42.464868 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:16:42.465264 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:16:42.465761 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:16:42.480858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:42.481700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:42.482529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:42.482960 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:42.532727 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Getting quotas for project b7869946a7ac4ac7a15fab3dfe687abd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:16:42.538307 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Getting quotas for user 34edc297b377425b92683fc6530e8135 and project b7869946a7ac4ac7a15fab3dfe687abd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:16:42.552004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:16:42.555103 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:16:42.647301 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f21b990-f0b2-4f30-9d75-39a9dbdcbde0 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963624 Jul 04 09:16:42.648544 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 114/236] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:16:42.666601 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-61c40990-8565-440d-9760-323fe550b28f tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:42.669391 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-61c40990-8565-440d-9760-323fe550b28f tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:42.670935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:42.684504 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c43e1bf6-48a9-467e-be09-8128a7c61242 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.271335 Jul 04 09:16:42.687083 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 123/237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:42 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:42.692989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:42.693798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:42.717475 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:42.718175 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:42.720043 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:42.721326 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:42.752025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-61c40990-8565-440d-9760-323fe550b28f tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:42.767259 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-61c40990-8565-440d-9760-323fe550b28f tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1213 microversion: 2.1 time: 0.111843 Jul 04 09:16:42.768935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 115/238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:42 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:42.954893 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:42.967367 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-53d7cde7-b9ce-4841-8043-da1cc08d5626 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1319 microversion: 2.1 time: 0.278838 Jul 04 09:16:42.968036 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 124/239] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:42 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:43.190502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1434836875", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1158946767", "security_groups": [{"name": "tempest-secgroup-smoke-453758316"}], "networks": [{"uuid": "5a2c8810-cb52-4371-861a-661d1c6a6165"}], "block_device_mapping_v2": [{"uuid": "ab2e20e8-4deb-403f-83c7-d3ca597767a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:43.311259 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] validate_networks() for [('5a2c8810-cb52-4371-861a-661d1c6a6165', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:16:43.703577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:43.704175 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:43.710994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:16:43.710994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:16:43.711835 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:16:43.712274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:16:43.712683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:16:43.725102 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:43.725548 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:43.726352 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:43.726783 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:43.731444 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:43.731926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:43.732737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:43.733164 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:43.767524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Getting quotas for project 33b3e0ba3aa644ddbbee8f56be21ad06. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:16:43.772612 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Getting quotas for user 5ba79c77fcd54bbcb673a5cba1ed2975 and project 33b3e0ba3aa644ddbbee8f56be21ad06. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:16:43.845676 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:16:43.847950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab2e20e8-4deb-403f-83c7-d3ca597767a2',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:16:43.898858 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:43.907679 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-945b3050-e0af-4735-809d-881b03379db0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.207803 Jul 04 09:16:43.909100 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 125/240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:43 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:43.914217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d53a2707-479f-4011-956f-733bfa0d95df tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:43.923523 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d53a2707-479f-4011-956f-733bfa0d95df tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:43.925023 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d53a2707-479f-4011-956f-733bfa0d95df tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:43.995967 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:43.998622 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d53a2707-479f-4011-956f-733bfa0d95df tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Going to try to stop instance {{(pid=117795) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 09:16:44.041418 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0a541d57-e1cf-4c8e-b0dc-49c546a57113 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.856938 Jul 04 09:16:44.042633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 116/241] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:16:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:16:44.048788 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:44.049592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:44.057676 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.058830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:44.064517 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.065954 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:44.083081 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d53a2707-479f-4011-956f-733bfa0d95df tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action" status: 202 len: 0 microversion: 2.1 time: 0.172147 Jul 04 09:16:44.083672 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 126/242] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:16:43 2022] POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:16:44.092415 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:44.094020 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:44.107208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.108030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:44.108992 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.109620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:44.196178 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:44.223961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-de3bf98b-e719-4a76-ae57-064f2e899dba tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1209 microversion: 2.1 time: 0.173892 Jul 04 09:16:44.243328 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 117/243] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:44 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1209 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:44.248563 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e15b7b96-8178-4e55-8e77-dfa059b1eb28 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:44.262895 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e15b7b96-8178-4e55-8e77-dfa059b1eb28 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:44.385268 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e15b7b96-8178-4e55-8e77-dfa059b1eb28 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:44.392043 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e15b7b96-8178-4e55-8e77-dfa059b1eb28 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1089 microversion: 2.1 time: 0.147285 Jul 04 09:16:44.393063 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 118/244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:44 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1089 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:44.409651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:44.410486 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:44.419273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.419419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:44.420400 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.421053 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:44.446408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:44.455054 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8ba5413a-bbee-44df-90dd-8620d08ea6a1 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1319 microversion: 2.1 time: 0.369171 Jul 04 09:16:44.457928 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 127/245] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:44 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:44.619729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:44.630070 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ad18ad7f-2d5c-4c9c-981f-e977d778c806 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.225395 Jul 04 09:16:44.634673 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 119/246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:44 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:44.927567 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:44.929825 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:44.940259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.940689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:44.945263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:44.945778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.155893 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:45.166398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fffd5564-01bb-47b0-8c85-beffd176abaf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.245461 Jul 04 09:16:45.166990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 128/247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:44 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:45.244588 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:45.245822 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:45.254272 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.254719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.255675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.256470 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.331385 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:45.341098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5c1fa5ed-a6e4-45e8-befd-d84f3aafcabf tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1271 microversion: 2.1 time: 0.102679 Jul 04 09:16:45.342442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 120/248] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:45 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:45.410805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:45.412718 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:45.420247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.421143 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.422713 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.423600 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.472731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:45.475274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:45.484488 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.485154 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.488513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.489152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.595730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:45.604265 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2705fc89-bbd0-4492-be09-9070937a32fd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1187 microversion: 2.1 time: 0.198019 Jul 04 09:16:45.605299 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 129/249] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:45 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1187 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:45.654608 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:45.655665 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:45.668957 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.669733 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.670770 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:45.671543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:45.826610 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:45.858413 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e3b5c2f4-345c-4b3b-845a-4fa18ed52f93 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1319 microversion: 2.1 time: 0.389536 Jul 04 09:16:45.868288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 121/250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:45 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:45.935524 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:45.945594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-77fde1cb-ff08-47f4-baa3-6c26836a9ef8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.296873 Jul 04 09:16:45.954395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 130/251] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:45 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:46.184590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:46.185290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:46.191853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.192399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.193336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.193841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.198672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:46.359096 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:46.359742 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:46.368039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.368482 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.369272 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.369708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.382120 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:46.388836 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6f4afe37-0767-440b-85c9-344b4ecd7ebf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.208538 Jul 04 09:16:46.389438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 122/252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:46 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:46.513504 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:46.521700 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bcc9eca9-c714-4943-8683-0c6e7abf3887 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.166429 Jul 04 09:16:46.522462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 131/253] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:46 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:46.621714 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:46.622458 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:46.629792 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.630378 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.631235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.631774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.702699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:46.710682 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fb80bd2a-174e-4170-b6b4-9aedd44fd55e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1205 microversion: 2.1 time: 0.092863 Jul 04 09:16:46.711311 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 123/254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:46 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:46.875200 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:46.875795 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:46.882735 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.883197 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.883964 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.884444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.904396 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:46.964983 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:46.966086 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:46.973325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.974107 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:46.975227 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:46.975885 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.080757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:47.094413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d37a4319-b6f9-4c8f-8ada-1142be31416a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1319 microversion: 2.1 time: 0.222913 Jul 04 09:16:47.098086 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 132/255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:46 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:47.184585 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:47.194143 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f5ee7e1a-1eb0-4ec6-8f03-b854405637f5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.233573 Jul 04 09:16:47.195000 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 124/256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:46 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:47.348921 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-725425515", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:47.409572 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:47.410446 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:47.430929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:47.432642 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.434551 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:47.435409 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.447755 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] validate_networks() for None {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:16:47.795395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:47.803718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e69d2998-5d8e-4703-b32a-3953df7b4dee tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.398652 Jul 04 09:16:47.804309 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 125/257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:47 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:47.808690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-dc5e7a9c-f58f-4df7-b713-86a5328a7b75 req-053061f9-b52d-4bd0-91c9-d3473e3ccd1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1cd838-20f2-4b96-9f17-c1382deb7479", "name": "network-vif-plugged", "status": "completed", "tag": "72947163-4128-451c-9a62-4c4564d8be60"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:47.817694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-dc5e7a9c-f58f-4df7-b713-86a5328a7b75 req-053061f9-b52d-4bd0-91c9-d3473e3ccd1b service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:47.818423 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-dc5e7a9c-f58f-4df7-b713-86a5328a7b75 req-053061f9-b52d-4bd0-91c9-d3473e3ccd1b service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.830884 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-dc5e7a9c-f58f-4df7-b713-86a5328a7b75 req-053061f9-b52d-4bd0-91c9-d3473e3ccd1b service nova] Creating event network-vif-plugged:72947163-4128-451c-9a62-4c4564d8be60 for instance bd1cd838-20f2-4b96-9f17-c1382deb7479 on hv-cinder-81914 Jul 04 09:16:47.836531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-dc5e7a9c-f58f-4df7-b713-86a5328a7b75 req-053061f9-b52d-4bd0-91c9-d3473e3ccd1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031120 Jul 04 09:16:47.837616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 126/258] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:47.843937 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:47.844849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:47.852634 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:47.853251 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.854405 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:47.855005 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.866164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:16:47.866679 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:16:47.867182 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:16:47.867593 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:16:47.868001 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:16:47.879487 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:47.879940 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.884152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:47.884600 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:47.904535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Getting quotas for project 10fc941c0bca498e9d6cfeed12f0c6ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:16:47.915949 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Getting quotas for user a2435e1faabf48b0922de38e93215a48 and project 10fc941c0bca498e9d6cfeed12f0c6ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:16:47.930280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:16:47.932702 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:16:47.999530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-adcc9156-faea-4cfe-b94c-6879a3e39e3e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657712 Jul 04 09:16:48.005653 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 133/259] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:16:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:16:48.014422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:48.016878 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:48.024601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.025058 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.025835 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.026444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.056163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:48.071845 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-47bb0b96-93e9-4ff8-bedd-eeab9ea41c68 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.226105 Jul 04 09:16:48.072989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 127/260] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:47 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:48.085112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-d6a5887a-2835-4ebf-9355-841059d10502 req-93eeeee6-a3e6-4f26-ba4a-919c51b347c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a1e180-e636-400d-97b7-57132b3d6af8", "tag": "0a264e9f-7a6c-4987-8482-bd9161ba3ca3"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:48.098275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d6a5887a-2835-4ebf-9355-841059d10502 req-93eeeee6-a3e6-4f26-ba4a-919c51b347c8 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.098715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d6a5887a-2835-4ebf-9355-841059d10502 req-93eeeee6-a3e6-4f26-ba4a-919c51b347c8 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.124055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-d6a5887a-2835-4ebf-9355-841059d10502 req-93eeeee6-a3e6-4f26-ba4a-919c51b347c8 service nova] Creating event network-changed:0a264e9f-7a6c-4987-8482-bd9161ba3ca3 for instance e4a1e180-e636-400d-97b7-57132b3d6af8 on hv-cinder-81914 Jul 04 09:16:48.139501 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-d6a5887a-2835-4ebf-9355-841059d10502 req-93eeeee6-a3e6-4f26-ba4a-919c51b347c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065015 Jul 04 09:16:48.140136 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 128/261] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:48.148767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-20bcbd84-0d82-48be-b336-892477e48903 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:48.149731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-20bcbd84-0d82-48be-b336-892477e48903 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:48.232657 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:48.245126 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ae0df604-c79e-46bb-a137-513d71945b0c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.237913 Jul 04 09:16:48.255004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-20bcbd84-0d82-48be-b336-892477e48903 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:48.255497 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 134/262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:48 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:48.257509 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-20bcbd84-0d82-48be-b336-892477e48903 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1214 microversion: 2.1 time: 0.115995 Jul 04 09:16:48.258258 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 129/263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:48 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:48.261360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:48.262187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:48.268491 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.269195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.270160 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.270845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.271375 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:48.272123 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:48.280150 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.280667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.281444 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.281936 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.550650 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:48.561045 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0d18afac-2a91-4df9-9a9b-0be77a779973 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1319 microversion: 2.1 time: 0.303993 Jul 04 09:16:48.562196 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 135/264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:48 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:48.572083 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:48.589579 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7fe51972-b5d4-4155-8c6b-d3db9782ae56 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.330313 Jul 04 09:16:48.590201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 130/265] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:48 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:48.820855 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:48.821415 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:48.828013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.828447 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.829197 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:48.829620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:48.972491 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:48.980234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-126b6708-f2aa-4d1d-b55d-3ad3aa91bd0b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.163228 Jul 04 09:16:48.980804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 136/266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:48 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:49.089604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:49.090288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:49.096724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.097197 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.097982 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.098424 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.233805 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:49.241693 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1f63b067-4c43-46c1-bb37-b0e0db164fd8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.155954 Jul 04 09:16:49.242286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 131/267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:49 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:49.265764 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:49.266383 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:49.275499 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.276087 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.277214 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.277382 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:49.277634 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.278029 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:49.285944 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.286338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.287266 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.287724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.366155 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:49.373510 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7721799c-f35a-49f1-bf92-fceabe09f3ba tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1210 microversion: 2.1 time: 0.101700 Jul 04 09:16:49.374120 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 132/268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:49 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:49.445134 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:49.453132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4831adfd-e2c7-488f-828f-b59a63737343 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.193441 Jul 04 09:16:49.453710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 137/269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:49 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:49.577780 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:49.580468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:49.590891 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.591338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.592165 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.592583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.607343 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:49.607936 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:49.615203 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.615613 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.616395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:49.616822 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:49.800129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:49.808163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ff7610f-505d-4e9f-8908-5c66c5a92b54 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1319 microversion: 2.1 time: 0.234222 Jul 04 09:16:49.808432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:49.808719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 133/270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:49 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:49.816802 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f9ea254a-8c06-470a-8f5b-6460aa3d45c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.213266 Jul 04 09:16:49.817392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 138/271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:49 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:49.997468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:49.998131 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.008963 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.009493 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.010797 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.011292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.146286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:50.154973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-b52a5640-ed9c-4ec2-b56b-ab48c7e716fe req-97a35994-46bc-44aa-b987-cf69e901aa94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f2244b-757a-430f-aeb4-c6c6a6d94214", "tag": "78c383e3-0712-437b-8c6a-9bd8b90e67f0"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:50.162397 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-623bf32d-db82-4156-abc6-9f285cc549ba tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1500 microversion: 2.1 time: 0.169469 Jul 04 09:16:50.163065 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 134/272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:49 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:50.163479 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-b52a5640-ed9c-4ec2-b56b-ab48c7e716fe req-97a35994-46bc-44aa-b987-cf69e901aa94 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.163907 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-b52a5640-ed9c-4ec2-b56b-ab48c7e716fe req-97a35994-46bc-44aa-b987-cf69e901aa94 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.175642 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-b52a5640-ed9c-4ec2-b56b-ab48c7e716fe req-97a35994-46bc-44aa-b987-cf69e901aa94 service nova] Creating event network-changed:78c383e3-0712-437b-8c6a-9bd8b90e67f0 for instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 on hv-cinder-81914 Jul 04 09:16:50.179262 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93696910-4e2d-4f70-a8f0-f4b17e149082"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:50.180460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.180656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-b52a5640-ed9c-4ec2-b56b-ab48c7e716fe req-97a35994-46bc-44aa-b987-cf69e901aa94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029287 Jul 04 09:16:50.181260 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 139/273] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:50.186913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.187368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.188128 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.188557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.211432 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] HTTP exception thrown: Cannot 'attach_volume' instance eb12a448-abd1-4f71-a368-8e85bedaf38b while it is in vm_state rescued Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Request method failure captured: Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b/os-volume_attachments HTTP/1.1 Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 74 Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-OmtcNhVqntRlyIJLc3i65jC9RnMZJxWJq6ip8ODRno-ES3hTRMNX1nVDJhcIj2eLLKlqBYLLGPpwZFZa0dvMfRnfnNpiSvpsx2tdP6Qp76HuIKnsEPgum2S9fpT5PoOZ830fcCeV8ULI8q_N0FJ-gJrrtFKqql9PSwROWs13s4vM Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:16:50.213114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_48690ebc49824572a08f53597eeee661", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/48690ebc49824572a08f53597eeee661"}]}] Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 1e916bf18efe421895c8d7b28fcd55d5 Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {"volumeAttachment": {"volumeId": "93696910-4e2d-4f70-a8f0-f4b17e149082"}} Jul 04 09:16:50.214524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Cannot 'attach_volume' instance eb12a448-abd1-4f71-a368-8e85bedaf38b while it is in vm_state rescued Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'server_id': 'eb12a448-abd1-4f71-a368-8e85bedaf38b', 'body': {'volumeAttachment': {'volumeId': '93696910-4e2d-4f70-a8f0-f4b17e149082'}}} Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eb12a448-abd1-4f71-a368-8e85bedaf38b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:16:50.215344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance eb12a448-abd1-4f71-a368-8e85bedaf38b while it is in vm_state rescued Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:16:50.216597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:16:50.217859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:16:50.217859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:16:50.217859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance eb12a448-abd1-4f71-a368-8e85bedaf38b while it is in vm_state rescued Jul 04 09:16:50.217859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:16:50.217859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Returning 409 to user: Cannot 'attach_volume' instance eb12a448-abd1-4f71-a368-8e85bedaf38b while it is in vm_state rescued {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:16:50.217859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-887e997e-82ba-4b3a-8a9c-4c56e22f5c6b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039371 Jul 04 09:16:50.217859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 135/274] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:16:50 2022] POST /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 04 09:16:50.224212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a3ae0abf-48ff-45ce-b170-a5f1f2b21101 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:50.224854 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a3ae0abf-48ff-45ce-b170-a5f1f2b21101 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.231065 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3ae0abf-48ff-45ce-b170-a5f1f2b21101 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.231506 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3ae0abf-48ff-45ce-b170-a5f1f2b21101 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.232282 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3ae0abf-48ff-45ce-b170-a5f1f2b21101 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.232710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3ae0abf-48ff-45ce-b170-a5f1f2b21101 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.258329 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:50.258931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.266480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.266921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.267674 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.268485 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.303585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a3ae0abf-48ff-45ce-b170-a5f1f2b21101 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b/action" status: 202 len: 0 microversion: 2.1 time: 0.083503 Jul 04 09:16:50.304403 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 140/275] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:16:50 2022] POST /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:16:50.312646 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:50.313338 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.319798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.320367 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.321152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.321578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.445082 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:50.452905 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2c9714f4-4450-485b-97fe-d5d88cd573ad tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.198968 Jul 04 09:16:50.453647 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 136/276] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:50 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:50.458453 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:50.459090 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.466019 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.466439 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.467222 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.467649 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.490090 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:50.498765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6d11c7f3-1700-4737-806a-a8063ddfec7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1508 microversion: 2.1 time: 0.190134 Jul 04 09:16:50.508389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 141/277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:50 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:50.508389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:50.508389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.531953 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.532599 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.533813 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.534337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.535894 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:50.546300 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0e813900-23f9-427d-8699-d14a630f143f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1266 microversion: 2.1 time: 0.091290 Jul 04 09:16:50.546925 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 137/278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:50 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:50.696130 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:50.703552 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ccd2ef76-a772-4560-b5c2-2b0ce83c24db tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.202402 Jul 04 09:16:50.704115 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 142/279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:50 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:50.828883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:50.829960 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.841702 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.842672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.844115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.844343 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:50.844905 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.845546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:50.852482 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.852929 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:50.853702 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:50.854297 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.053953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:51.056848 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:51.065375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9f183f3c-cca2-4a66-8e50-24ee3decbc4b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.227784 Jul 04 09:16:51.066238 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 143/280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:50 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:51.067929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-58b5fa4f-8c3a-458b-905e-e5058cdbce20 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1508 microversion: 2.1 time: 0.240773 Jul 04 09:16:51.068971 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 138/281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:50 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:51.473822 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:51.475087 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:51.481457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.481918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.482696 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.483228 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.517952 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:51.518501 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:51.528026 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.533505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.534639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.535272 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.683467 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:51.693723 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d9f79118-149a-475c-9131-5e19c2bb57e4 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.223872 Jul 04 09:16:51.694637 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 144/282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:51 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:51.709233 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:51.709961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:51.711763 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:51.716443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.716889 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.717662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.718305 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.719502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0f0f3a2c-f3e3-4df2-9349-03f50b339ef9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1508 microversion: 2.1 time: 0.205448 Jul 04 09:16:51.720066 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 139/283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:51 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:51.729737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:51.729737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:51.732098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.732604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.733323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:51.733785 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:51.786604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:51.796450 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-347d8e4a-2ea9-4f03-acb3-8daca0803095 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1274 microversion: 2.1 time: 0.091849 Jul 04 09:16:51.797038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 145/284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:51 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:51.888531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:51.896583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-16497e21-da44-4c30-a335-fc47b0a1f57e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.175555 Jul 04 09:16:51.897130 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 140/285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:51 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:52.083828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:52.084429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:52.091291 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:52.091730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:52.092480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:52.092906 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:52.446377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:52.454577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6a7fe886-3b86-4217-8ef9-8575fe05dd07 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.374764 Jul 04 09:16:52.455148 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 146/286] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:52 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:52.711599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:52.712283 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:52.722189 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:52.722939 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:52.723946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:52.724563 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:52.741154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:52.741811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:52.744137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:52.750173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:52.751093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:52.752085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:52.752707 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:52.765828 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:53.027771 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:53.030824 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:53.037008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-061e4df3-37e7-432c-8aa8-8aca4916672c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1508 microversion: 2.1 time: 0.301539 Jul 04 09:16:53.037970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 147/287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:52 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:53.046619 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4b240705-c7c0-4de7-b491-fbe21ca58796 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.339181 Jul 04 09:16:53.047417 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 141/288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:52 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:53.051926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:53.052527 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:53.055655 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:53.056408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:53.062665 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:53.063104 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:53.063879 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:53.064307 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:53.071981 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:53.072431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:53.073216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:53.073642 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:53.200154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:53.208592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-51742e77-905f-4270-8ff9-2e9ce08396e0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1272 microversion: 2.1 time: 0.169867 Jul 04 09:16:53.209216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 148/289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:53 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:53.322139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:53.333491 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c338bc18-54b5-4076-a954-a1e44201ca1b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.284951 Jul 04 09:16:53.335827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 142/290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:53 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:53.472782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:53.473407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:53.484936 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:53.485415 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:53.486453 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:53.486693 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:53.511125 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:53.763061 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:53.775613 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b896622f-e724-4cae-b090-04590ae27a81 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.306838 Jul 04 09:16:53.776799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 149/291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:53 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:54.056252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:54.057791 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:54.061485 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:54.065943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:54.067276 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:54.074576 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.075026 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.075807 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.077315 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.092547 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.100125 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.104007 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.105968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.454716 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:54.465438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5564d191-3c91-42fc-a52a-5e0764ad8a58 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1508 microversion: 2.1 time: 0.413854 Jul 04 09:16:54.465629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:54.466065 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 143/292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:54 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:54.483972 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-af57f32e-4c29-4dae-a35a-5105c355de8b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.423161 Jul 04 09:16:54.485427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 150/293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:54 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:54.495006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:54.495685 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:54.501424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:54.506137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:54.514860 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.515577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.517956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.519135 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.522999 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.523734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.526577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.527237 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.871637 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:54.879940 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5f927d8f-16b6-4c67-963b-aa4967a1a4a3 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.411764 Jul 04 09:16:54.880732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 144/294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:54 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:54.884411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:54.886857 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:54.887667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:54.895042 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5d77a7fd-5d81-4487-918a-d95c49d43851 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.407308 Jul 04 09:16:54.896011 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.896459 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.897689 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:54.898317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:54.900596 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 151/295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:54 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:55.114590 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-8280e5ea-33c7-456c-a408-c071955582ae req-42003599-e320-4592-b313-a1c783a8ab7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd4a835-f591-497f-a46a-d554fb77c61c", "tag": "c914bc7d-ca25-4a3f-93ad-48ff175d244c"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:55.120868 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:55.130881 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-8280e5ea-33c7-456c-a408-c071955582ae req-42003599-e320-4592-b313-a1c783a8ab7d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.131545 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-8280e5ea-33c7-456c-a408-c071955582ae req-42003599-e320-4592-b313-a1c783a8ab7d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.136390 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-976f6741-3b2b-4b89-a15f-a1be6e0e57b3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.254330 Jul 04 09:16:55.136991 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 145/296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:54 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:55.144897 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-8280e5ea-33c7-456c-a408-c071955582ae req-42003599-e320-4592-b313-a1c783a8ab7d service nova] Creating event network-changed:c914bc7d-ca25-4a3f-93ad-48ff175d244c for instance 2cd4a835-f591-497f-a46a-d554fb77c61c on hv-cinder-81914 Jul 04 09:16:55.150054 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-8280e5ea-33c7-456c-a408-c071955582ae req-42003599-e320-4592-b313-a1c783a8ab7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039473 Jul 04 09:16:55.151135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 152/297] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:16:55.462985 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-b67823fd-c2b8-4754-8b5d-7c937d49d9c0 req-08ca8713-6c79-4ff6-b014-62355aef5b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a1e180-e636-400d-97b7-57132b3d6af8", "name": "network-vif-plugged", "status": "completed", "tag": "0a264e9f-7a6c-4987-8482-bd9161ba3ca3"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:55.471433 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b67823fd-c2b8-4754-8b5d-7c937d49d9c0 req-08ca8713-6c79-4ff6-b014-62355aef5b0d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.471966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b67823fd-c2b8-4754-8b5d-7c937d49d9c0 req-08ca8713-6c79-4ff6-b014-62355aef5b0d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.483610 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-b67823fd-c2b8-4754-8b5d-7c937d49d9c0 req-08ca8713-6c79-4ff6-b014-62355aef5b0d service nova] Creating event network-vif-plugged:0a264e9f-7a6c-4987-8482-bd9161ba3ca3 for instance e4a1e180-e636-400d-97b7-57132b3d6af8 on hv-cinder-81914 Jul 04 09:16:55.485305 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:55.486365 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:55.488849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-b67823fd-c2b8-4754-8b5d-7c937d49d9c0 req-08ca8713-6c79-4ff6-b014-62355aef5b0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 Jul 04 09:16:55.489186 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 146/298] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:16:55.494064 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.494620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.495995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.502357 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.507248 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:55.508072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:55.514844 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.515431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.516649 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.517179 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.726636 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:55.738413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a785a7d5-9f90-42c6-baba-75d849a4ea15 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1508 microversion: 2.1 time: 0.257295 Jul 04 09:16:55.739578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 153/299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:55 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:55.747490 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:55.755279 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5e7750fd-2ebd-42e4-995a-024db38850a7 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.255518 Jul 04 09:16:55.755836 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 147/300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:55 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:55.898020 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:55.898584 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:55.906727 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.907251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.908154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.908581 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.913372 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:55.914117 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:55.920352 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.920815 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:55.921570 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:55.922033 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:56.112356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:56.120047 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-96c3651a-5b5a-4460-9f7f-54957bbda436 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.226520 Jul 04 09:16:56.120603 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 154/301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:55 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:56.128789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:56.138429 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d25403ef-05a2-4454-bd43-399c4c2beaf9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.229010 Jul 04 09:16:56.139014 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 148/302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:55 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:56.152932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:56.153535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:56.159796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:56.160239 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:56.161003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:56.161435 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:56.295192 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:56.304356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8f1638d6-8aeb-4729-b090-a5dd415c9c17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.155190 Jul 04 09:16:56.305029 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 155/303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:56 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:56.756503 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:56.757113 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:56.764527 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:56.765046 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:56.765821 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:56.766278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:56.772452 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:56.773247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:56.780899 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:56.781451 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:56.782254 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:56.782684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:57.000408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:57.008413 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e2aaebe4-3c4a-40a4-b6c5-87b2345ab23a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1508 microversion: 2.1 time: 0.255879 Jul 04 09:16:57.009070 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 149/304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:56 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:57.025569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:57.036566 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-cd80777b-e84d-4a18-8233-aad555d0cf2a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.267724 Jul 04 09:16:57.037343 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 156/305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:56 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:57.137526 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:57.138116 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:57.144852 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:57.145304 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:57.146097 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:57.146539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:57.156260 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:57.157157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:57.164232 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:57.164708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:57.165491 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:57.165919 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:57.354875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:57.358975 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:57.365003 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-553881ca-277e-413c-9488-a08e317ceb20 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.231786 Jul 04 09:16:57.365556 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 150/306] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:57 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:57.370320 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:57.371219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:57.372449 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5cbd9d52-c190-4127-8812-49c755c5dc39 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.220248 Jul 04 09:16:57.373236 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 157/307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:57 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:57.379236 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:57.379674 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:57.380447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:57.380887 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:57.577927 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:57.587117 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4d9f7a85-3fdc-428d-be1f-11feb845f6fe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.220216 Jul 04 09:16:57.587984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 151/308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:57 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:58.028402 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:58.029248 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:58.032634 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:58.033473 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:58.038520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.039014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.040039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.040602 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.064992 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:58.065966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:58.072559 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.073124 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.074027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.074585 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.254295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=26 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:16:58.281210 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:58.284534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:58.289329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2fd1c7fd-f668-48a9-aa0c-0944fee3d9df tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1514 microversion: 2.1 time: 0.267046 Jul 04 09:16:58.290107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 158/309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:58 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:58.292515 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-23ff00d0-fd20-4350-b1b7-406df043ff44 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.237922 Jul 04 09:16:58.293092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 152/310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:58 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:16:58.382830 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:58.383692 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:58.389854 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:58.390485 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:58.392617 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.393228 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.394788 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.395429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.397174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.397822 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.398729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.399127 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.611626 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:58.615529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:58.619707 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f3189297-3907-4be5-bcd1-94a8540e0188 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.241739 Jul 04 09:16:58.620301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 159/311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:58 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:58.624357 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4701a12a-fb1c-4dee-8379-6157a14eef78 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.238857 Jul 04 09:16:58.626080 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:58.626229 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 153/312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:58 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:58.627077 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:58.633575 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.634433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.636332 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:58.637042 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:58.994970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:59.003332 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a4fbf5b1-c35c-4508-a84c-d32716ee7099 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1720 microversion: 2.1 time: 0.381767 Jul 04 09:16:59.003897 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 160/313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:58 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:59.308776 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:59.309454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:59.317518 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:59.318239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:59.319183 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:59.319794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:59.452231 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:59.460145 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3205a217-40ad-486d-a72e-f17da72b1976 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1313 microversion: 2.1 time: 0.155360 Jul 04 09:16:59.460741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 154/314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:59 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:59.637438 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:59.639002 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:59.646369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:16:59.646864 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:59.647012 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:16:59.647883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:59.648941 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:59.649563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:59.654499 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:59.654943 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:59.655691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:16:59.656124 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:16:59.867059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:59.881466 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-256cbaae-e1cc-4212-8161-eaebee26deb0 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.248732 Jul 04 09:16:59.891247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 161/315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:59 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:59.891901 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:16:59.896221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dad93864-471c-49cd-b2ce-71a1d099e6b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'create', calling method: .version_select at 0x7f8e8119e670>, body: {"keypair": {"name": "tempest-keypair-283158391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEr0B/iyqFXTbIjK1Yn+tBSCmTUzU7tXHcTe9o1VwjCHkZF0pF9Rv2Cp1VznCUg17dEHwv7ullreRuJhqqZIV5AYoIyC6sRNpanuaULVf+Z6UZtlnp9fBJJt2j0RXxOCTw=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:16:59.899338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e2eff64c-d0a4-4e9e-a708-9d3553ee1b58 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.256889 Jul 04 09:16:59.908731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 155/316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:16:59 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:16:59.910719 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-dad93864-471c-49cd-b2ce-71a1d099e6b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for project 48690ebc49824572a08f53597eeee661. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:16:59.914889 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-dad93864-471c-49cd-b2ce-71a1d099e6b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for user 1e916bf18efe421895c8d7b28fcd55d5 and project 48690ebc49824572a08f53597eeee661. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:16:59.940201 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dad93864-471c-49cd-b2ce-71a1d099e6b5 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047710 Jul 04 09:16:59.940805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 162/317] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:16:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:00.021164 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:00.021835 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:00.032590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.034332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.035252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.035672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.221192 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:00.229342 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-18eb8a74-4bf3-4e31-800f-2b093d113457 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1697 microversion: 2.1 time: 0.212590 Jul 04 09:17:00.230228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 156/318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:00 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:00.247432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7eb0120e-bfe8-495b-9088-b9dc7d1dcd76 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:00.253758 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7eb0120e-bfe8-495b-9088-b9dc7d1dcd76 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.254485 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7eb0120e-bfe8-495b-9088-b9dc7d1dcd76 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.279743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7eb0120e-bfe8-495b-9088-b9dc7d1dcd76 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Going to try to start instance {{(pid=117795) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 09:17:00.330399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7eb0120e-bfe8-495b-9088-b9dc7d1dcd76 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action" status: 202 len: 0 microversion: 2.1 time: 0.087256 Jul 04 09:17:00.331632 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 163/319] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:17:00 2022] POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:17:00.339713 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:00.340968 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:00.352924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.353375 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.354466 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.355059 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.478698 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:00.480116 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:00.491500 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.492107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.493358 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.493929 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.518538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:00.531296 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ca0e0183-27c8-4817-9f7a-7e42e3e41636 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1706 microversion: 2.1 time: 0.194546 Jul 04 09:17:00.532095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 157/320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:00 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1706 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:00.659048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:00.667801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a25eb6c2-ae4c-470f-98f7-b5ee07fec9d6 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1498 microversion: 2.1 time: 0.194756 Jul 04 09:17:00.668359 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 164/321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:00 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:00.898406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:00.899296 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:00.905391 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.906123 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.906953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.907522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.916893 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:00.917647 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:00.924850 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.925313 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:00.926683 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:00.927265 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:01.225652 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:01.231226 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:01.240757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-84beb3a6-1609-4676-a6b1-6f68c157faa9 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.346343 Jul 04 09:17:01.244654 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 158/322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:00 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:01.284749 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:01.293008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-030fd435-a5ba-48d3-9f9a-00c6b75a0c35 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.380430 Jul 04 09:17:01.293623 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 165/323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:00 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:01.550197 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:01.550928 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:01.560205 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:01.560899 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:01.561966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:01.562547 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:01.585950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:01.586594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:01.603465 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:01.604624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:01.605406 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:01.605841 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:01.645666 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:17:01.651158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:01.738923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-30fd66c2-e208-497c-abc2-7a321265d0b9 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 204 len: 0 microversion: 2.1 time: 0.156564 Jul 04 09:17:01.742692 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 166/324] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:17:01 2022] DELETE /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:17:01.748408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1410051170", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df1b751e-d6ba-48eb-89e1-23cec336922c"}], "security_groups": [{"name": "tempest-securitygroup--466828185"}], "key_name": "tempest-keypair-283158391", "user_data": "}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:01.763084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:01.772035 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6b0ed50b-c3a8-4bc9-a117-56b5c3380ed3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1706 microversion: 2.1 time: 0.225904 Jul 04 09:17:01.772602 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 159/325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:01 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1706 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:01.786642 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:01.787696 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:01.798814 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:01.799253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:01.800027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:01.800449 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.006883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] validate_networks() for [('df1b751e-d6ba-48eb-89e1-23cec336922c', None, None, None, None, None)] {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:17:02.107264 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:02.115915 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3ffdf590-d95f-4e6d-b40b-bc9db9f1caf2 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1504 microversion: 2.1 time: 0.341735 Jul 04 09:17:02.129950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 160/326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:01 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:02.261447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:02.262154 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:02.268266 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.268740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.269820 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.270060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.494200 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:02.502832 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-54b64893-c8cd-429c-bb21-e5cfeb7ed780 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.245396 Jul 04 09:17:02.503439 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 161/327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:02 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:02.507961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:02.508916 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:02.515285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.515727 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.516462 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.517059 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.524869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:17:02.525275 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:17:02.525858 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:17:02.526173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:17:02.526601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:17:02.537027 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.537475 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.538303 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.538746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.558013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for project 48690ebc49824572a08f53597eeee661. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:17:02.563965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Getting quotas for user 1e916bf18efe421895c8d7b28fcd55d5 and project 48690ebc49824572a08f53597eeee661. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:17:02.576494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:17:02.579014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:17:02.642588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7451d690-d6a1-4ed6-aa36-abe7c10753fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.901499 Jul 04 09:17:02.648798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 167/328] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:17:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:17:02.666760 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c5a99525-cb2e-4707-baa0-594a193b5c55 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:02.667855 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c5a99525-cb2e-4707-baa0-594a193b5c55 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:02.707953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:02.717988 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6a3d1a1b-a315-4a8b-b020-a1e984f030fe tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.213412 Jul 04 09:17:02.719364 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 162/329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:02 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:02.741995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c5a99525-cb2e-4707-baa0-594a193b5c55 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:02.748640 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c5a99525-cb2e-4707-baa0-594a193b5c55 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1245 microversion: 2.1 time: 0.088786 Jul 04 09:17:02.749217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 168/330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:02 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:02.789566 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:02.790236 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:02.796295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.796740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.797493 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.797936 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.932380 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:02.943813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bf0bb3d6-d82e-4b24-99f1-5e03bddfd840 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1706 microversion: 2.1 time: 0.158385 Jul 04 09:17:02.944854 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 163/331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:02 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1706 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:03.135781 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:03.136786 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:03.143997 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.144459 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.145554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.146191 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.284702 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:03.294220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f6257a52-c564-4406-8326-745181a7c39a tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1504 microversion: 2.1 time: 0.163938 Jul 04 09:17:03.295014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 169/332] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:03 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:03.519134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:03.520045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:03.522396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:03.528013 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.528449 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.529214 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.529769 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.640220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-01bff8d0-0623-446a-bcc7-e20e360fdba1 req-f15679da-4f23-4d46-9d48-fdd39b08dad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f2244b-757a-430f-aeb4-c6c6a6d94214", "name": "network-vif-plugged", "status": "completed", "tag": "78c383e3-0712-437b-8c6a-9bd8b90e67f0"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:03.650087 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-01bff8d0-0623-446a-bcc7-e20e360fdba1 req-f15679da-4f23-4d46-9d48-fdd39b08dad8 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.650999 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-01bff8d0-0623-446a-bcc7-e20e360fdba1 req-f15679da-4f23-4d46-9d48-fdd39b08dad8 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.667247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-01bff8d0-0623-446a-bcc7-e20e360fdba1 req-f15679da-4f23-4d46-9d48-fdd39b08dad8 service nova] Creating event network-vif-plugged:78c383e3-0712-437b-8c6a-9bd8b90e67f0 for instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 on hv-cinder-81914 Jul 04 09:17:03.670011 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:03.672161 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-01bff8d0-0623-446a-bcc7-e20e360fdba1 req-f15679da-4f23-4d46-9d48-fdd39b08dad8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037244 Jul 04 09:17:03.672951 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 170/333] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:17:03.678461 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9d5cc16d-29bd-469f-96f5-390bd0b8c96b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.163096 Jul 04 09:17:03.679140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 164/334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:03 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:03.751273 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:03.752167 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:03.766233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:03.767488 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:03.768862 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.772212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.773104 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.773591 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.783535 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.785256 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.786576 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.787483 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.061068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:04.072191 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-07a9fca8-63b6-46b6-aab3-22dafadec7d1 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1297 microversion: 2.1 time: 0.309978 Jul 04 09:17:04.084195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 165/335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:03 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1297 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:04.091661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:04.092829 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:04.099864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:04.101201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.102522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:04.103168 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.380164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:04.388400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-55687304-a96e-4959-a86f-183dc0dc6a89 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.653732 Jul 04 09:17:04.397212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 171/336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:03 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:04.408641 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:04.411108 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:04.428414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:04.428910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.429668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:04.430140 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.716892 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:04.720945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:04.724936 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f350f4f9-aa77-4b9c-b52b-007c15f5bc9b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1462 microversion: 2.1 time: 0.326393 Jul 04 09:17:04.725485 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 172/337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:04 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1462 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:04.729861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-1c034011-84c7-40c3-a52e-02c531e042e2 req-ed87be52-6f73-4fc0-91a2-6728d3d224a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a1e180-e636-400d-97b7-57132b3d6af8", "name": "network-vif-deleted", "tag": "0a264e9f-7a6c-4987-8482-bd9161ba3ca3"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:04.733661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e1abee09-5500-4177-9a9e-5a119bf6da17 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1706 microversion: 2.1 time: 0.647281 Jul 04 09:17:04.734373 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 166/338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:04 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1706 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:04.738689 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:04.739293 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:04.745287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:04.745846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.746074 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1c034011-84c7-40c3-a52e-02c531e042e2 req-ed87be52-6f73-4fc0-91a2-6728d3d224a1 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:04.746625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:04.746765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1c034011-84c7-40c3-a52e-02c531e042e2 req-ed87be52-6f73-4fc0-91a2-6728d3d224a1 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.747045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:04.760051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-1c034011-84c7-40c3-a52e-02c531e042e2 req-ed87be52-6f73-4fc0-91a2-6728d3d224a1 service nova] Creating event network-vif-deleted:0a264e9f-7a6c-4987-8482-bd9161ba3ca3 for instance e4a1e180-e636-400d-97b7-57132b3d6af8 on hv-cinder-81914 Jul 04 09:17:04.766271 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-1c034011-84c7-40c3-a52e-02c531e042e2 req-ed87be52-6f73-4fc0-91a2-6728d3d224a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039477 Jul 04 09:17:04.767828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 173/339] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:04.893605 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:04.901954 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0d36c372-0618-4122-8cfd-b101c5ec476d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.166697 Jul 04 09:17:04.902533 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 167/340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:04 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:05.091412 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:05.092125 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:05.099102 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.099483 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.100292 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.100943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.306359 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:05.317400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3673f3e9-672f-4bc5-83f9-95e07bcfc5a9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1303 microversion: 2.1 time: 0.229875 Jul 04 09:17:05.318245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 174/341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:05 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:05.414799 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:05.415614 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:05.424235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.424703 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.425537 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.426423 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.603924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:05.615943 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-402cbe17-cc84-473d-94ca-27b3422bfcbf tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1260 microversion: 2.1 time: 0.206846 Jul 04 09:17:05.616947 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 168/342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:05 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:05.694229 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-32089a46-66df-480e-994e-e72f896a1c3c req-6702ac81-31f1-4188-a354-f84b718519d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd4a835-f591-497f-a46a-d554fb77c61c", "name": "network-vif-plugged", "status": "completed", "tag": "c914bc7d-ca25-4a3f-93ad-48ff175d244c"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:05.702376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-32089a46-66df-480e-994e-e72f896a1c3c req-6702ac81-31f1-4188-a354-f84b718519d8 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.702877 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-32089a46-66df-480e-994e-e72f896a1c3c req-6702ac81-31f1-4188-a354-f84b718519d8 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.714329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-32089a46-66df-480e-994e-e72f896a1c3c req-6702ac81-31f1-4188-a354-f84b718519d8 service nova] Creating event network-vif-plugged:c914bc7d-ca25-4a3f-93ad-48ff175d244c for instance 2cd4a835-f591-497f-a46a-d554fb77c61c on hv-cinder-81914 Jul 04 09:17:05.719534 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-32089a46-66df-480e-994e-e72f896a1c3c req-6702ac81-31f1-4188-a354-f84b718519d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029012 Jul 04 09:17:05.720135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 175/343] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:05.742201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:05.742808 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:05.749233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.749683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.750497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.750705 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:05.750925 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.751528 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:05.759958 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.760708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.761561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.761923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.785250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.785653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.786309 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lazy-loading 'fault' on Instance uuid e4a1e180-e636-400d-97b7-57132b3d6af8 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:17:05.850802 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:05.859592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-73fa48b7-5607-4e0c-9a99-5276aec806df tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1303 microversion: 2.1 time: 0.121417 Jul 04 09:17:05.860392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 169/344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:05 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:05.918700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:05.926043 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:05.933031 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.933525 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:05.934577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:05.935111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.024965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:06.034394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0bcbe6bc-e784-497b-998e-48f10c1abd4c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1710 microversion: 2.1 time: 0.287937 Jul 04 09:17:06.035033 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 176/345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:05 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1710 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:06.136251 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:06.144289 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-58eb2daa-ce0c-4fbd-8f31-e9e40bed062e tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.229219 Jul 04 09:17:06.144907 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 170/346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:05 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:06.334995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:06.335642 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:06.356127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.356553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.357307 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.357757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.486256 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:06.496365 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b525dc33-77e6-4f38-a47a-686fda8f8846 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1303 microversion: 2.1 time: 0.165194 Jul 04 09:17:06.497363 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 177/347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:06 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:06.632862 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:06.633476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:06.640633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.641077 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.641975 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.642498 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.785904 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:06.794115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e516806e-127d-4a6a-b9f4-d75ddff6b03b tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1443 microversion: 2.1 time: 0.165357 Jul 04 09:17:06.794692 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 171/348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:06 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:06.812217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:06.812835 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:06.819299 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.819748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.820628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.821085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.876659 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:06.877541 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:06.889987 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.890745 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.893029 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.895722 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.938890 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:06.940006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:06.940664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lazy-loading 'fault' on Instance uuid e4a1e180-e636-400d-97b7-57132b3d6af8 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:17:07.020706 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34edc297b377425b92683fc6530e8135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7869946a7ac4ac7a15fab3dfe687abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:07.028843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6f7f021c-71fd-4f0f-9d68-9075944db3f8 tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 200 len: 1303 microversion: 2.1 time: 0.156039 Jul 04 09:17:07.039515 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 172/349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:06 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 1303 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:07.105559 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:07.113659 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1dbd1eb4-130a-46ef-b885-b324c889b981 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1443 microversion: 2.1 time: 0.306210 Jul 04 09:17:07.114370 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 178/350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:06 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1443 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:07.161412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:07.162057 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:07.173176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:07.173630 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:07.174437 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:07.176325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:07.402812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:07.411091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b4b19327-ea19-44c5-92b1-e7848caf134b tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.254400 Jul 04 09:17:07.421932 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 173/351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:07 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:07.513198 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:07.513811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:07.525985 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:07.526517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:07.531537 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:07.532039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:07.811041 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:07.823035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3c43f1dc-29d2-4cf4-97b9-f2eadd717151 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.313966 Jul 04 09:17:07.823764 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 179/352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:07 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:07.883970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a3428e4c-4fa8-4c4a-98bd-fe81fd05c23c req-e49312dc-ae3b-4263-9bdf-ff6ab363698b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f404500c-0f77-4248-94bb-8d1eaf63a0bc", "tag": "0cb1b91f-f4e7-4260-86d4-761589933b09"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:07.896096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a3428e4c-4fa8-4c4a-98bd-fe81fd05c23c req-e49312dc-ae3b-4263-9bdf-ff6ab363698b service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:07.896923 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a3428e4c-4fa8-4c4a-98bd-fe81fd05c23c req-e49312dc-ae3b-4263-9bdf-ff6ab363698b service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:07.926122 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a3428e4c-4fa8-4c4a-98bd-fe81fd05c23c req-e49312dc-ae3b-4263-9bdf-ff6ab363698b service nova] Creating event network-changed:0cb1b91f-f4e7-4260-86d4-761589933b09 for instance f404500c-0f77-4248-94bb-8d1eaf63a0bc on hv-cinder-81914 Jul 04 09:17:07.926362 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a3428e4c-4fa8-4c4a-98bd-fe81fd05c23c req-e49312dc-ae3b-4263-9bdf-ff6ab363698b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045769 Jul 04 09:17:07.927414 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 174/353] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:08.046824 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:08.047809 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] [instance: e4a1e180-e636-400d-97b7-57132b3d6af8] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:08.053517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:08.055895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:08.056610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:08.057716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:08.058366 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:08.082174 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] HTTP exception thrown: Instance e4a1e180-e636-400d-97b7-57132b3d6af8 could not be found. Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Request method failure captured: Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 HTTP/1.1 Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq_bKcLqxSnk9xx9EcB8elvS3PhV8U2IdmMpxxsNzPKOlqDDi4ApV26fHbGnhzYDe_B-97vfWTXtnALCZr01tXkb5Cz8jEhVvFys-rXReeFrqnG9ajs2d0olaRdKMfnN6kW9ETxm3cjbuduQdhFC_jxExB9OS9f0oojfCFSgWhvlECs Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: b7869946a7ac4ac7a15fab3dfe687abd Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesActionsTest-1509157531 Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:17:08.084620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7869946a7ac4ac7a15fab3dfe687abd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7869946a7ac4ac7a15fab3dfe687abd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7869946a7ac4ac7a15fab3dfe687abd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7869946a7ac4ac7a15fab3dfe687abd"}]}] Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesActionsTest-1509157531 Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: b7869946a7ac4ac7a15fab3dfe687abd Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesActionsTest-1509157531 Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesActionsTest-1509157531-project Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 34edc297b377425b92683fc6530e8135 Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesActionsTest-1509157531-project Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance e4a1e180-e636-400d-97b7-57132b3d6af8 could not be found. Jul 04 09:17:08.086484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'e4a1e180-e636-400d-97b7-57132b3d6af8'} Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a1e180-e636-400d-97b7-57132b3d6af8 could not be found. Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:17:08.087546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a1e180-e636-400d-97b7-57132b3d6af8 could not be found. Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a1e180-e636-400d-97b7-57132b3d6af8 could not be found. Jul 04 09:17:08.089038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:08.091473 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] Returning 404 to user: Instance e4a1e180-e636-400d-97b7-57132b3d6af8 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:17:08.092568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d6b66f6a-736a-464b-bfca-4665c56d0f2b tempest-VolumesActionsTest-1509157531 tempest-VolumesActionsTest-1509157531-project] 10.222.0.26 "GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8" status: 404 len: 111 microversion: 2.1 time: 0.049626 Jul 04 09:17:08.100607 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 180/354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:08 2022] GET /compute/v2.1/servers/e4a1e180-e636-400d-97b7-57132b3d6af8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:17:08.437273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:08.438207 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:08.447224 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:08.447675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:08.448473 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:08.448913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:08.495894 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:08.639346 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:08.655469 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-20c4deb8-2a96-4961-9537-a20ec718ae1f tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1314 microversion: 2.1 time: 0.227360 Jul 04 09:17:08.662909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 175/355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:08 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:08.839910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:08.840505 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:08.846973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:08.847675 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:08.848604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:08.849176 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:09.010336 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:09.018523 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0c1fffe5-d3ed-4ce1-9bee-b306a2fbbda9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.182847 Jul 04 09:17:09.019113 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 181/356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:08 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:09.466890 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-70d9c23a-6158-4016-a16f-384d3fe5ad12 req-eb5ba804-4f5c-409f-a940-511f38afdcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f2244b-757a-430f-aeb4-c6c6a6d94214", "tag": "78c383e3-0712-437b-8c6a-9bd8b90e67f0"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:09.476090 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-70d9c23a-6158-4016-a16f-384d3fe5ad12 req-eb5ba804-4f5c-409f-a940-511f38afdcb3 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:09.476525 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-70d9c23a-6158-4016-a16f-384d3fe5ad12 req-eb5ba804-4f5c-409f-a940-511f38afdcb3 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:09.488672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-70d9c23a-6158-4016-a16f-384d3fe5ad12 req-eb5ba804-4f5c-409f-a940-511f38afdcb3 service nova] Creating event network-changed:78c383e3-0712-437b-8c6a-9bd8b90e67f0 for instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 on hv-cinder-81914 Jul 04 09:17:09.493582 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-70d9c23a-6158-4016-a16f-384d3fe5ad12 req-eb5ba804-4f5c-409f-a940-511f38afdcb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030424 Jul 04 09:17:09.494843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 176/357] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:09.670075 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:09.670762 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:09.677912 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:09.678489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:09.679289 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:09.679797 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:09.814448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:09.822319 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a2248507-e04d-46ca-8719-4fc90b922a7d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1463 microversion: 2.1 time: 0.156635 Jul 04 09:17:09.822888 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 182/358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:09 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:09.862636 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:09.863383 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:09.869966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:09.870422 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:09.871406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:09.871711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:09.896885 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:17:09.972557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d2e5fdaf-8a5e-4d9e-8932-7845536ffbe8 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 204 len: 0 microversion: 2.1 time: 0.113719 Jul 04 09:17:09.973051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 177/359] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:17:09 2022] DELETE /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:17:09.981334 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:09.981933 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:09.988634 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:09.989081 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:09.989846 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:09.990465 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:10.036084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:10.036789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:10.042959 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:10.043408 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:10.044176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:10.044608 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:10.186511 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:10.195051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-46a1cc9f-4187-4576-a835-6e0476fe16c5 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1469 microversion: 2.1 time: 0.217584 Jul 04 09:17:10.195628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 183/360] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:09 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:10.214687 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:10.222503 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0fecc6e2-5ca3-4cd6-9de5-becf92d874fc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.190716 Jul 04 09:17:10.223278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 178/361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:10 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:11.214173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:11.214948 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:11.223708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:11.224259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:11.225257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:11.225826 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:11.241365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:11.242118 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:11.248931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:11.249381 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:11.250186 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:11.250625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:11.427372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:11.434897 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:11.435084 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2261d161-0a20-41d0-9561-78add0c9b631 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1469 microversion: 2.1 time: 0.226108 Jul 04 09:17:11.435646 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 184/362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:11 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:11.445071 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a0534b03-8fc2-45dc-b535-c72dfc9b3e7b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.208421 Jul 04 09:17:11.445858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 179/363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:11 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:12.457073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:12.458999 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:12.466667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:12.467783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:12.476272 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:12.476861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:12.477634 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:12.477772 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:12.478103 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:12.478242 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:12.478881 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:12.479308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:12.545122 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:12.670903 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:12.674174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:12.679414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fa4b8720-bae3-4740-8e43-738c14c77093 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1469 microversion: 2.1 time: 0.229304 Jul 04 09:17:12.680161 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 185/364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:12 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1469 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:12.681802 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-db6f8fef-df99-40f5-92c1-b086b984e997 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.221652 Jul 04 09:17:12.682381 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 180/365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:12 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:13.695796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:13.696434 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:13.698924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:13.700034 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=12 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:13.701771 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:13.704480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:13.704998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:13.705821 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:13.706433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:13.709672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:13.710137 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:13.711048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:13.711543 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:13.711989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:13.905244 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:13.907528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:13.915568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f56d6eba-a720-491f-a65d-cbf888a2e23d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1469 microversion: 2.1 time: 0.223698 Jul 04 09:17:13.919449 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a14fab63-8eff-4b55-96c8-d8bcfdbfbb70 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.223765 Jul 04 09:17:13.920583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 181/366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:13 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:13.921901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 186/367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:13 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:13.971399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4a3db7da-c76c-4c37-81d3-35075edbaead tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f0f780f-22aa-4c89-9549-ae54444b8489", "device": "/dev/sdb"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:13.974916 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4a3db7da-c76c-4c37-81d3-35075edbaead tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:13.983780 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a3db7da-c76c-4c37-81d3-35075edbaead tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:13.984414 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a3db7da-c76c-4c37-81d3-35075edbaead tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:13.985638 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a3db7da-c76c-4c37-81d3-35075edbaead tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:13.986213 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a3db7da-c76c-4c37-81d3-35075edbaead tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:14.936063 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:14.939464 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:14.951665 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:14.954781 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:14.956995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:14.958085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:15.239785 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:15.247668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ab7d5f55-7a5a-462d-bc67-6e10f0a19201 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1469 microversion: 2.1 time: 0.318463 Jul 04 09:17:15.250679 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 187/368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:14 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:15.261668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:15.263924 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:15.276997 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:15.282515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:15.283565 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:15.284161 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:15.309085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4a3db7da-c76c-4c37-81d3-35075edbaead tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "POST /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.342405 Jul 04 09:17:15.310998 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 182/369] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:17:13 2022] POST /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479/os-volume_attachments => generated 194 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:15.498286 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:15.515110 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-251e35a4-78e8-41bf-892f-405ceeb700c6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.257465 Jul 04 09:17:15.525138 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 188/370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:15 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:16.061022 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-d4c60440-a74b-4f0a-a5dc-1520dbfd73b0 req-a7fcf2b6-115f-4eae-8526-579b83c50f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd4a835-f591-497f-a46a-d554fb77c61c", "name": "network-vif-deleted", "tag": "c914bc7d-ca25-4a3f-93ad-48ff175d244c"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:16.078611 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d4c60440-a74b-4f0a-a5dc-1520dbfd73b0 req-a7fcf2b6-115f-4eae-8526-579b83c50f48 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.081394 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d4c60440-a74b-4f0a-a5dc-1520dbfd73b0 req-a7fcf2b6-115f-4eae-8526-579b83c50f48 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.105741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-d4c60440-a74b-4f0a-a5dc-1520dbfd73b0 req-a7fcf2b6-115f-4eae-8526-579b83c50f48 service nova] Creating event network-vif-deleted:c914bc7d-ca25-4a3f-93ad-48ff175d244c for instance 2cd4a835-f591-497f-a46a-d554fb77c61c on hv-cinder-81914 Jul 04 09:17:16.116877 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-d4c60440-a74b-4f0a-a5dc-1520dbfd73b0 req-a7fcf2b6-115f-4eae-8526-579b83c50f48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064434 Jul 04 09:17:16.122602 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 183/371] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:16.267711 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:16.268346 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:16.282367 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.282825 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.283948 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.284391 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.337066 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.337778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.339221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lazy-loading 'fault' on Instance uuid 2cd4a835-f591-497f-a46a-d554fb77c61c {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:17:16.398179 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2435e1faabf48b0922de38e93215a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fc941c0bca498e9d6cfeed12f0c6ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:16.407439 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8d07553f-60e7-46b3-8677-c9e9ce290865 tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 200 len: 1304 microversion: 2.1 time: 0.143586 Jul 04 09:17:16.417428 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 189/372] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:16 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:16.533697 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:16.534420 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:16.546032 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.546562 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.548187 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.548722 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.744692 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:16.763399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e2c1b013-dd18-4cf9-8f5e-b25d1df1a672 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.231336 Jul 04 09:17:16.764622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 184/373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:16 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:17.425664 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:17.427335 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] [instance: 2cd4a835-f591-497f-a46a-d554fb77c61c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:17.437717 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:17.438482 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:17.439267 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:17.439863 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:17.456662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] HTTP exception thrown: Instance 2cd4a835-f591-497f-a46a-d554fb77c61c could not be found. Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Request method failure captured: Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c HTTP/1.1 Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq_9VIhVYeu2dk1uJWd3lYxolTdJ7SwDBE4mpPh9HDlETap1jKyxakkweJJOVKkz7ZZ9vZ_VyBAw9PwINX2RnDy-3sPZT9d_huFHaKxF6jAGe_hl4-o_lf2Lv7hQBri1MuQK11KmIlIUuH8Qy2xoVQ_uBLYeFtp772m_a7rtnwU_NyM Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 10fc941c0bca498e9d6cfeed12f0c6ef Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesNegativeTest-1917116041 Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:17:17.458633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10fc941c0bca498e9d6cfeed12f0c6ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10fc941c0bca498e9d6cfeed12f0c6ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10fc941c0bca498e9d6cfeed12f0c6ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10fc941c0bca498e9d6cfeed12f0c6ef"}]}] Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesNegativeTest-1917116041 Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 10fc941c0bca498e9d6cfeed12f0c6ef Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesNegativeTest-1917116041 Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesNegativeTest-1917116041-project Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: a2435e1faabf48b0922de38e93215a48 Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesNegativeTest-1917116041-project Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 2cd4a835-f591-497f-a46a-d554fb77c61c could not be found. Jul 04 09:17:17.460220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '2cd4a835-f591-497f-a46a-d554fb77c61c'} Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cd4a835-f591-497f-a46a-d554fb77c61c could not be found. Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:17:17.461158 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd4a835-f591-497f-a46a-d554fb77c61c could not be found. Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd4a835-f591-497f-a46a-d554fb77c61c could not be found. Jul 04 09:17:17.462671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:17.464729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] Returning 404 to user: Instance 2cd4a835-f591-497f-a46a-d554fb77c61c could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:17:17.465737 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-74b277bc-3b29-4ba7-85b7-6c41ee21620d tempest-VolumesNegativeTest-1917116041 tempest-VolumesNegativeTest-1917116041-project] 10.222.0.26 "GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c" status: 404 len: 111 microversion: 2.1 time: 0.044771 Jul 04 09:17:17.488664 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 190/374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:17 2022] GET /compute/v2.1/servers/2cd4a835-f591-497f-a46a-d554fb77c61c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:17:17.780622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:17.781254 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:17.789274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:17.792329 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:17.794619 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:17.801989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:18.013180 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:18.022171 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-11362bc5-c678-4139-9215-c5be607d4276 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.245384 Jul 04 09:17:18.022759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 185/375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:17 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:17:19.039708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:19.040488 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:19.050431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:19.052344 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:19.053350 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:19.054759 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:19.224748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:19.236951 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ab3cf346-5abb-4d5d-b817-2948c115cf4c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.201162 Jul 04 09:17:19.238411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 191/376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:19 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:19.870859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e985360f-36b9-4154-8c20-9c9772702212 req-029aa37f-3e00-4480-b14f-25de94ca5e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f404500c-0f77-4248-94bb-8d1eaf63a0bc", "name": "network-vif-plugged", "status": "completed", "tag": "0cb1b91f-f4e7-4260-86d4-761589933b09"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:19.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e985360f-36b9-4154-8c20-9c9772702212 req-029aa37f-3e00-4480-b14f-25de94ca5e82 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:19.897110 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e985360f-36b9-4154-8c20-9c9772702212 req-029aa37f-3e00-4480-b14f-25de94ca5e82 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:19.926321 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e985360f-36b9-4154-8c20-9c9772702212 req-029aa37f-3e00-4480-b14f-25de94ca5e82 service nova] Creating event network-vif-plugged:0cb1b91f-f4e7-4260-86d4-761589933b09 for instance f404500c-0f77-4248-94bb-8d1eaf63a0bc on hv-cinder-81914 Jul 04 09:17:19.941003 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e985360f-36b9-4154-8c20-9c9772702212 req-029aa37f-3e00-4480-b14f-25de94ca5e82 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074542 Jul 04 09:17:19.942412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 186/377] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:20.256143 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:20.258205 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:20.268003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:20.268962 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:20.270718 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:20.271390 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:20.594353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:20.609771 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-260ef94a-24f3-4d01-870d-1a9647829df7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.351889 Jul 04 09:17:20.610652 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 192/378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:20 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:21.630056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:21.632386 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:21.653694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:21.654577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:21.655591 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:21.656235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:21.900532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:21.910554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-79b24c06-e76e-4b9b-8aa7-e2de18640040 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1370 microversion: 2.1 time: 0.286111 Jul 04 09:17:21.912443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 187/379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:21 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:22.929409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:22.930654 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:22.942982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:22.944699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:22.945547 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:22.950693 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:23.223714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:23.232818 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1ac195e8-60c6-4772-9d2e-f4aa9916433a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1564 microversion: 2.1 time: 0.307211 Jul 04 09:17:23.233400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 193/380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:22 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1564 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:23.253536 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-39a29341-d9a8-42b2-bbf4-571ed3e249e9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:23.256265 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-39a29341-d9a8-42b2-bbf4-571ed3e249e9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:23.264703 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39a29341-d9a8-42b2-bbf4-571ed3e249e9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:23.265492 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39a29341-d9a8-42b2-bbf4-571ed3e249e9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:23.266789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39a29341-d9a8-42b2-bbf4-571ed3e249e9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:23.267432 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39a29341-d9a8-42b2-bbf4-571ed3e249e9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:23.384004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-39a29341-d9a8-42b2-bbf4-571ed3e249e9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134483 Jul 04 09:17:23.385746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 188/381] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:17:23 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:25.514534 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-3cd260f3-8887-4d00-9ab6-5ffc562e66e6 req-8d35d271-9af2-47f8-97f1-cc9547583730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f404500c-0f77-4248-94bb-8d1eaf63a0bc", "tag": "0cb1b91f-f4e7-4260-86d4-761589933b09"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:25.526199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-3cd260f3-8887-4d00-9ab6-5ffc562e66e6 req-8d35d271-9af2-47f8-97f1-cc9547583730 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:25.526935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-3cd260f3-8887-4d00-9ab6-5ffc562e66e6 req-8d35d271-9af2-47f8-97f1-cc9547583730 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:25.543168 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-3cd260f3-8887-4d00-9ab6-5ffc562e66e6 req-8d35d271-9af2-47f8-97f1-cc9547583730 service nova] Creating event network-changed:0cb1b91f-f4e7-4260-86d4-761589933b09 for instance f404500c-0f77-4248-94bb-8d1eaf63a0bc on hv-cinder-81914 Jul 04 09:17:25.554094 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-3cd260f3-8887-4d00-9ab6-5ffc562e66e6 req-8d35d271-9af2-47f8-97f1-cc9547583730 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043422 Jul 04 09:17:25.554743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 194/382] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:33.087564 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-300cde89-e060-4c1e-a3e9-7b7ec02ddcff tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Action: 'create', calling method: .version_select at 0x7f8e810c6670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-673347094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKxKNmaBNsbQzNHdhtWpnBoytywaQ27XTfN17cAiwqnQCHTcZ9QeYxh8nLqVuge9u6wsxEDfqNPt97mgGooYCabjXeE8hOpN4l3JkIQXGYyNR7OkZFdR+HDihNDRcKWmA=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:33.122332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-300cde89-e060-4c1e-a3e9-7b7ec02ddcff tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for project dc462a5ff5f649cdb9a24f2232855724. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:17:33.146601 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-300cde89-e060-4c1e-a3e9-7b7ec02ddcff tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for user f884304cbb764a8ab4927c3ba8db892d and project dc462a5ff5f649cdb9a24f2232855724. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:17:33.190191 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-300cde89-e060-4c1e-a3e9-7b7ec02ddcff tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.377357 Jul 04 09:17:33.191602 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 189/383] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:17:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:41.999980 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:42.000662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:42.004381 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=31 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:42.005946 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=46 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:42.011560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:42.011976 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:42.012937 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:42.013356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:42.150781 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lazy-loading 'services' on Instance uuid bd1cd838-20f2-4b96-9f17-c1382deb7479 {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:17:42.276678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a789215f-4fd8-47af-99f5-3d4d16e3bf19 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479/os-volume_attachments/9f0f780f-22aa-4c89-9549-ae54444b8489" status: 202 len: 0 microversion: 2.1 time: 0.280729 Jul 04 09:17:42.277574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 195/384] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:17:41 2022] DELETE /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479/os-volume_attachments/9f0f780f-22aa-4c89-9549-ae54444b8489 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:17:43.420301 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:43.421639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:43.422450 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:43.427291 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:43.427876 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:43.437478 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:43.437966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:43.438724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:43.439152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:43.468595 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:17:43.551595 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3b41b5a0-05f6-4a70-b392-9ba64f0621dd tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 204 len: 0 microversion: 2.1 time: 0.131551 Jul 04 09:17:43.552221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 190/385] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:17:43 2022] DELETE /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:17:43.562042 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:43.562841 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:43.569448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:43.570012 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:43.570782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:43.571214 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:43.711982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:43.719432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b1760f98-ab9a-4ab6-b5d2-ecde0f8b2aba tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1514 microversion: 2.1 time: 0.162112 Jul 04 09:17:43.719996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 196/386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:43 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:44.737392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:44.738202 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:44.744999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:44.745477 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:44.746272 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:44.746705 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:44.891480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:44.899692 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ac6af899-264a-4c64-9181-a4d232ed9d76 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1514 microversion: 2.1 time: 0.166428 Jul 04 09:17:44.900270 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 191/387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:44 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:45.918700 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:45.920536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:45.929674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:45.930217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:45.931350 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:45.932144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:46.222311 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:46.229805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5a768e87-4a0d-4f76-91c0-7ab0a3d3e95a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 200 len: 1514 microversion: 2.1 time: 0.315073 Jul 04 09:17:46.230414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 197/388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:45 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 1514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:46.529289 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-be95ea87-dd03-4a02-86ae-0e2ee694a216 req-f9e8bd19-25be-4b54-95f7-fc130ae6a4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1cd838-20f2-4b96-9f17-c1382deb7479", "name": "network-vif-deleted", "tag": "72947163-4128-451c-9a62-4c4564d8be60"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:46.541158 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-be95ea87-dd03-4a02-86ae-0e2ee694a216 req-f9e8bd19-25be-4b54-95f7-fc130ae6a4d0 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:46.541595 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-be95ea87-dd03-4a02-86ae-0e2ee694a216 req-f9e8bd19-25be-4b54-95f7-fc130ae6a4d0 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:46.555475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-be95ea87-dd03-4a02-86ae-0e2ee694a216 req-f9e8bd19-25be-4b54-95f7-fc130ae6a4d0 service nova] Creating event network-vif-deleted:72947163-4128-451c-9a62-4c4564d8be60 for instance bd1cd838-20f2-4b96-9f17-c1382deb7479 on hv-cinder-81914 Jul 04 09:17:46.560695 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-be95ea87-dd03-4a02-86ae-0e2ee694a216 req-f9e8bd19-25be-4b54-95f7-fc130ae6a4d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035326 Jul 04 09:17:46.561928 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 192/389] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:47.247491 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:47.248183 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: bd1cd838-20f2-4b96-9f17-c1382deb7479] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:47.254789 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:47.257932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:47.257932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:47.257932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:47.273725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] HTTP exception thrown: Instance bd1cd838-20f2-4b96-9f17-c1382deb7479 could not be found. Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Request method failure captured: Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 HTTP/1.1 Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq_0bliJMTDmN0dBX5PpSmCltuhRz7W_TSfjAa7sumraahzlrn6pNRSnVv6-jzSjKpSnZQZJ6IH8G3JznLpgqqGq9iPDnm-SPPmiDSd9EAv2RhuKUFPH6ayIdWVsotKugM1RB5D-GV7BghUZuSXTAHYTnuyHC3POYt2m0ENUUBF54Jw Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: fec91e0c883943448c9d0e8d4d5e09ae Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1605507432 Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:17:47.275410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fec91e0c883943448c9d0e8d4d5e09ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fec91e0c883943448c9d0e8d4d5e09ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fec91e0c883943448c9d0e8d4d5e09ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fec91e0c883943448c9d0e8d4d5e09ae"}]}] Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-VolumesSnapshotTestJSON-1605507432 Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: fec91e0c883943448c9d0e8d4d5e09ae Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1605507432 Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-VolumesSnapshotTestJSON-1605507432-project Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: c0ebb8aa3b7146e4a34a565969154f9a Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-VolumesSnapshotTestJSON-1605507432-project Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance bd1cd838-20f2-4b96-9f17-c1382deb7479 could not be found. Jul 04 09:17:47.276780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'bd1cd838-20f2-4b96-9f17-c1382deb7479'} Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1cd838-20f2-4b96-9f17-c1382deb7479 could not be found. Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:17:47.277778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1cd838-20f2-4b96-9f17-c1382deb7479 could not be found. Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1cd838-20f2-4b96-9f17-c1382deb7479 could not be found. Jul 04 09:17:47.279353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:17:47.280455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Returning 404 to user: Instance bd1cd838-20f2-4b96-9f17-c1382deb7479 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:17:47.280455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-50ffdba5-c0b8-4dce-95d3-c6e6dc76a730 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479" status: 404 len: 111 microversion: 2.1 time: 0.033276 Jul 04 09:17:47.280455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 198/390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:47 2022] GET /compute/v2.1/servers/bd1cd838-20f2-4b96-9f17-c1382deb7479 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:17:59.314765 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:59.315487 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:59.319744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-747256779", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "networks": [{"uuid": "19ba341d-8995-4ffa-b7cd-bd7817720293"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:17:59.370735 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] validate_networks() for [('19ba341d-8995-4ffa-b7cd-bd7817720293', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:17:59.718888 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:17:59.719300 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:17:59.719789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:17:59.720188 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:17:59.720613 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:17:59.730269 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:59.730714 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:59.731513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:59.731998 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:59.749648 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Getting quotas for project fec91e0c883943448c9d0e8d4d5e09ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:17:59.753730 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Getting quotas for user c0ebb8aa3b7146e4a34a565969154f9a and project fec91e0c883943448c9d0e8d4d5e09ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:17:59.765426 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:17:59.767773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:17:59.814461 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f506f8ad-b932-4e6a-a9ed-0fb276df07e8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501356 Jul 04 09:17:59.815269 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 193/391] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:17:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:17:59.825561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2b05af49-99d9-47cc-a725-e75271a99a8d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:59.826238 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2b05af49-99d9-47cc-a725-e75271a99a8d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:17:59.828324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=8 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:59.828979 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:59.883284 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2b05af49-99d9-47cc-a725-e75271a99a8d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:17:59.890831 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2b05af49-99d9-47cc-a725-e75271a99a8d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1218 microversion: 2.1 time: 0.068968 Jul 04 09:17:59.891416 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 199/392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:17:59 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:00.912880 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:00.913949 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:00.924598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:00.925333 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:00.926592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:00.927056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:00.991379 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:00.998984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b48b98dc-e6fd-48b2-a3ca-c55043afde5f tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1222 microversion: 2.1 time: 0.093282 Jul 04 09:18:00.999542 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 194/393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:00 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:02.016524 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:02.017123 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:02.023980 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:02.024424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:02.025180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:02.025606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:02.089773 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:02.098488 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c34f1a61-e73f-46dd-bb80-1807630ed201 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1270 microversion: 2.1 time: 0.085219 Jul 04 09:18:02.099056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 200/394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:02 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:03.115642 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:03.116187 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:03.123211 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:03.123663 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:03.124435 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:03.124903 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:03.348507 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:03.356385 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1efe0a5b-69a9-4a08-8daa-0e22503e03d7 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.244864 Jul 04 09:18:03.356956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 195/395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:03 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:03.627955 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-c704c57d-75eb-466d-afbc-d6d87953bcf8 req-0bb880e0-4183-40a5-adfa-a5ad5d0b13ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358be5c2-4340-47e3-a20d-ad976781f649", "tag": "b19eada3-7e7e-48e2-8cec-6d47b629d0f6"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:03.636639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c704c57d-75eb-466d-afbc-d6d87953bcf8 req-0bb880e0-4183-40a5-adfa-a5ad5d0b13ff service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:03.637372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c704c57d-75eb-466d-afbc-d6d87953bcf8 req-0bb880e0-4183-40a5-adfa-a5ad5d0b13ff service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:03.649642 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-c704c57d-75eb-466d-afbc-d6d87953bcf8 req-0bb880e0-4183-40a5-adfa-a5ad5d0b13ff service nova] Creating event network-changed:b19eada3-7e7e-48e2-8cec-6d47b629d0f6 for instance 358be5c2-4340-47e3-a20d-ad976781f649 on hv-cinder-81914 Jul 04 09:18:03.654631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-c704c57d-75eb-466d-afbc-d6d87953bcf8 req-0bb880e0-4183-40a5-adfa-a5ad5d0b13ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030390 Jul 04 09:18:03.655242 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 201/396] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:04.378511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:04.379691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:04.387186 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:04.387627 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:04.388366 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:04.388790 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:04.526502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:04.535947 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a4b6a5df-4acd-4ee2-b900-daf5f32275f8 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.164138 Jul 04 09:18:04.536534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 196/397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:04 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:05.562820 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:05.563843 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:05.571696 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:05.572144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:05.572908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:05.573341 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:05.709477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:05.720001 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-67a69e73-0f6e-4b0d-b998-1e649d7a55b6 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.164078 Jul 04 09:18:05.720843 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 202/398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:05 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:06.740614 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:06.741225 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:06.748140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:06.748585 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:06.749375 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:06.749812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:06.933998 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:06.942394 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3cb60b29-1167-4c0a-8e2a-3d30d8c0bfec tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.206819 Jul 04 09:18:06.944120 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 197/399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:06 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:07.963752 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:07.964347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:07.970619 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:07.971070 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:07.971828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:07.972264 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:08.113775 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:08.121674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-224ebb5b-4ebe-4a21-9d7e-d846965ec5b0 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.161753 Jul 04 09:18:08.122259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 203/400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:07 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:09.140779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:09.141434 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:09.149139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:09.149609 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:09.154846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:09.154846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:09.159923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1064426169", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-673347094", "security_groups": [{"name": "tempest-secgroup-smoke-1779143404"}], "block_device_mapping_v2": [{"uuid": "a200a09d-a17c-49e3-8524-7f8c9fab1df5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "956432d6-39cd-4134-be04-9d32af252f5a"}]}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:09.523263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] validate_networks() for [('956432d6-39cd-4134-be04-9d32af252f5a', None, None, None, None, None)] {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:18:09.530794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:09.539363 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f36e9994-cd84-4f22-8ce0-31ba3f4630fc tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.403849 Jul 04 09:18:09.540020 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 198/401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:09 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:09.889700 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:09.905085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:18:09.905509 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:18:09.906017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:18:09.906414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:18:09.908084 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:18:09.919227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:09.919882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:09.920683 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:09.921194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:09.939288 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for project dc462a5ff5f649cdb9a24f2232855724. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:18:09.944092 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for user f884304cbb764a8ab4927c3ba8db892d and project dc462a5ff5f649cdb9a24f2232855724. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:18:10.006114 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:18:10.008338 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a200a09d-a17c-49e3-8524-7f8c9fab1df5',volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:18:10.150434 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e1a95c3b-18a4-4603-9c5e-f19f6842080b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.994285 Jul 04 09:18:10.151282 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 204/402] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:18:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 09:18:10.161267 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e5475194-ec50-42ba-9c8c-6eb808efbe49 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:10.162446 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e5475194-ec50-42ba-9c8c-6eb808efbe49 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:10.164290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:10.164950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:10.222834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e5475194-ec50-42ba-9c8c-6eb808efbe49 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:10.230748 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e5475194-ec50-42ba-9c8c-6eb808efbe49 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1094 microversion: 2.1 time: 0.073573 Jul 04 09:18:10.231332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 199/403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:10 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:10.557501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:10.558244 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:10.567575 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:10.568027 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:10.568811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:10.569464 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:10.703874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:10.711847 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1a433d86-e473-4584-a43e-aace56e8e589 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.158339 Jul 04 09:18:10.712422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 205/404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:10 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:11.252098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:11.254580 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:11.267633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:11.268157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:11.268977 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:11.269401 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:11.347310 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:11.354929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cab34aa6-abe6-4fe6-b9b9-c3d7ed595487 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1210 microversion: 2.1 time: 0.110261 Jul 04 09:18:11.355494 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 200/405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:11 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:11.519989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-d74c6ed1-a72a-45ad-9bbc-c8ea3afdf433 req-177cd4a1-4af3-42da-a230-7e153b0ce9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358be5c2-4340-47e3-a20d-ad976781f649", "name": "network-vif-plugged", "status": "completed", "tag": "b19eada3-7e7e-48e2-8cec-6d47b629d0f6"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:11.528934 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-d74c6ed1-a72a-45ad-9bbc-c8ea3afdf433 req-177cd4a1-4af3-42da-a230-7e153b0ce9bd service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:11.529485 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-d74c6ed1-a72a-45ad-9bbc-c8ea3afdf433 req-177cd4a1-4af3-42da-a230-7e153b0ce9bd service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:11.541822 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-d74c6ed1-a72a-45ad-9bbc-c8ea3afdf433 req-177cd4a1-4af3-42da-a230-7e153b0ce9bd service nova] Creating event network-vif-plugged:b19eada3-7e7e-48e2-8cec-6d47b629d0f6 for instance 358be5c2-4340-47e3-a20d-ad976781f649 on hv-cinder-81914 Jul 04 09:18:11.547337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-d74c6ed1-a72a-45ad-9bbc-c8ea3afdf433 req-177cd4a1-4af3-42da-a230-7e153b0ce9bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031158 Jul 04 09:18:11.548328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 206/406] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:11.729837 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:11.730390 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:11.737750 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:11.739016 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:11.740072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:11.740501 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:11.953746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:11.972265 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fe953929-9299-41e0-888f-c65a79b7e960 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.246604 Jul 04 09:18:11.973055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 201/407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:11 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:12.373271 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:12.374071 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:12.381111 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:12.381846 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:12.382777 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:12.383233 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:12.604550 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:12.612240 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3f1d0107-7669-4c75-a699-0da371ba70e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.242977 Jul 04 09:18:12.623263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 207/408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:12 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:12.833293 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-2262d513-3d1a-4199-b5c8-5b1497ea00e6 req-939f8d69-4952-45d3-9afa-37d21cea6ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4c41fd-607b-4420-9719-5e0b6a2f47f2", "tag": "a4e977c6-a145-4cde-899f-60464a853272"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:12.843576 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2262d513-3d1a-4199-b5c8-5b1497ea00e6 req-939f8d69-4952-45d3-9afa-37d21cea6ff6 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:12.844087 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2262d513-3d1a-4199-b5c8-5b1497ea00e6 req-939f8d69-4952-45d3-9afa-37d21cea6ff6 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:12.857827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-2262d513-3d1a-4199-b5c8-5b1497ea00e6 req-939f8d69-4952-45d3-9afa-37d21cea6ff6 service nova] Creating event network-changed:a4e977c6-a145-4cde-899f-60464a853272 for instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 on hv-cinder-81914 Jul 04 09:18:12.865303 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-2262d513-3d1a-4199-b5c8-5b1497ea00e6 req-939f8d69-4952-45d3-9afa-37d21cea6ff6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036389 Jul 04 09:18:12.867016 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 202/409] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:12.990230 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:12.991220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:12.998038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:12.998483 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:12.999433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:13.000108 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:13.154560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:13.162499 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-46c7618c-d78e-419f-a20a-5b2ade67db6d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1318 microversion: 2.1 time: 0.176935 Jul 04 09:18:13.162947 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 208/410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:12 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:13.629538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:13.630290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:13.638861 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:13.639548 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:13.640520 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:13.641158 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:13.888304 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:13.899999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5c26081a-a926-4386-9bee-c8c0c3bf2e1d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.274592 Jul 04 09:18:13.900633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 203/411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:13 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:13.903267 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:13.903767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:13.910439 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:13.911090 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:13.911963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:13.912683 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:13.997785 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lazy-loading 'services' on Instance uuid b908667b-9eab-4249-b81a-acd8c6e40e86 {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:18:14.100894 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-77adfedf-9bf7-47c6-9c5f-7e65438a481e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-volume_attachments/2c2ed612-a0af-4359-9975-557537afdfab" status: 202 len: 0 microversion: 2.1 time: 0.201966 Jul 04 09:18:14.101491 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 209/412] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:18:13 2022] DELETE /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-volume_attachments/2c2ed612-a0af-4359-9975-557537afdfab => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:18:14.179704 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:14.180309 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:14.186407 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:14.186847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:14.187609 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:14.188038 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:14.433576 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:14.443120 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-449d30a8-7d9a-4760-ade1-4c2e64bc767b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1506 microversion: 2.1 time: 0.267562 Jul 04 09:18:14.446578 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 204/413] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:14 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:14.464854 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0c036045-597d-487d-8de6-70537fa5eb3c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1516b3da-7394-4f25-8f6d-a2bd257aadfb", "device": "/dev/sdb"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:14.467101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0c036045-597d-487d-8de6-70537fa5eb3c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:14.474617 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c036045-597d-487d-8de6-70537fa5eb3c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:14.475279 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c036045-597d-487d-8de6-70537fa5eb3c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:14.476206 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c036045-597d-487d-8de6-70537fa5eb3c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:14.477138 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0c036045-597d-487d-8de6-70537fa5eb3c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:14.923206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:14.928883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:14.946797 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:14.953695 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:14.956411 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:14.958341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:15.164166 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0c036045-597d-487d-8de6-70537fa5eb3c tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "POST /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.704136 Jul 04 09:18:15.165950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 210/414] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:18:14 2022] POST /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:15.308757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:15.321720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a4e63289-81d5-43aa-b8bb-9ee52bcd1fbb tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.408598 Jul 04 09:18:15.322349 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 205/415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:14 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:16.333977 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7131060a-088a-4de4-bf77-10f746db4f10 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:16.339285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:16.340558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:16.342264 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7131060a-088a-4de4-bf77-10f746db4f10 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:16.342776 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7131060a-088a-4de4-bf77-10f746db4f10 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:16.350830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:16.352226 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:16.353217 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:16.356023 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:16.408427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7131060a-088a-4de4-bf77-10f746db4f10 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Going to try to stop instance {{(pid=117795) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 09:18:16.478736 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7131060a-088a-4de4-bf77-10f746db4f10 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action" status: 202 len: 0 microversion: 2.1 time: 0.150623 Jul 04 09:18:16.479895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 211/416] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:18:16 2022] POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:18:16.490447 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:16.491220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:16.524974 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:16.525424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:16.526285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:16.526894 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:16.624981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:16.633847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-55ff2485-8a64-4758-a917-efd3648710aa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.298498 Jul 04 09:18:16.643642 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 206/417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:16 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:16.804952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:16.814304 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8d526b91-7585-49a0-b642-03a0abc15f22 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.329715 Jul 04 09:18:16.815011 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 212/418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:16 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:17.651104 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:17.652501 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:17.659803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.661158 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.662208 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.663592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.834430 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:17.835821 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:17.843682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.844554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.845394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.846480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.949660 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:17.958149 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-87fb18d7-8f80-435d-a3eb-e8cf6fc6e7f7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.310930 Jul 04 09:18:17.958937 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 207/419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:17 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:18.093947 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:18.103630 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3c6cdf2d-0fdf-4973-b198-b464bee2f0d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.273631 Jul 04 09:18:18.104218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 213/420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:17 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:18.983443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:18.984084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:18.992655 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:18.993096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:18.993860 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:18.994465 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:19.121824 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:19.123019 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:19.135455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:19.135905 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:19.136689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:19.137424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:19.157992 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:19.166210 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be04727f-f156-43e2-a0a7-d35aa734e048 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.191636 Jul 04 09:18:19.167613 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 208/421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:18 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:19.287553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:19.296108 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f72085c7-a7b1-46a6-b8bf-e1b8344c97d2 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.179361 Jul 04 09:18:19.296600 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 214/422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:19 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:20.183465 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:20.184668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:20.191220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:20.192613 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:20.194083 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:20.194687 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:20.229571 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:20.324011 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:20.327306 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:20.365980 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:20.367429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:20.371935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:20.372923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:20.373937 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:20.374524 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:20.414264 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:20.539989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:20.548821 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-40746721-0ed6-4415-9147-6d8ba375f101 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.368993 Jul 04 09:18:20.549306 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 209/423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:20 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:20.730544 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:20.738708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-396d4126-bfdc-4ed6-be49-e16784dfa899 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.424551 Jul 04 09:18:20.739291 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 215/424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:20 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:21.568732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:21.569350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:21.577715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:21.578190 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:21.578966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:21.579396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:21.756380 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:21.757929 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:21.765212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:21.765934 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:21.767268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:21.767921 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:22.025765 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:22.038478 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ec01be13-388a-4a4d-95e2-23b9827a2dc2 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.474540 Jul 04 09:18:22.044928 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 210/425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:21 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:22.179796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:22.189794 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b48fc83b-eba3-4115-8404-0d2ba8267545 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.437232 Jul 04 09:18:22.190669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 216/426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:21 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:23.055698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:23.056307 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:23.062904 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:23.063343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:23.064379 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:23.065044 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:23.209923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:23.211449 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:23.223747 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:23.224412 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:23.225301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:23.226676 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:23.270707 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:23.277940 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:23.281084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-015c803e-b6f4-4263-81aa-cbd93b561d5f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.229294 Jul 04 09:18:23.281678 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 211/427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:23 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:23.400395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:23.414517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b35b3051-36da-4ef2-8989-be669013b984 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.207286 Jul 04 09:18:23.415250 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 217/428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:23 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:24.298980 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:24.299572 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:24.306852 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:24.307292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:24.308054 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:24.308476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:24.432742 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:24.433994 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:24.445606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:24.446430 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:24.447127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:24.447569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:24.472237 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:24.481049 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a79711ea-40b4-4c00-9857-b3ff525607a6 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.186294 Jul 04 09:18:24.481872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 212/429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:24 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:24.651309 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:24.659316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-91fc7764-ea36-414b-932b-e8c4c640eef9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.230377 Jul 04 09:18:24.669396 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 218/430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:24 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:25.502137 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:25.503456 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:25.510854 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:25.514755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:25.515815 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:25.516410 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:25.522293 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-655f51de-3a27-4d56-a28b-76e3234cd32e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c9b1a1-a892-492d-b422-b47cad7da0d1"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:25.524114 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-655f51de-3a27-4d56-a28b-76e3234cd32e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:25.539095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-655f51de-3a27-4d56-a28b-76e3234cd32e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:25.539957 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-655f51de-3a27-4d56-a28b-76e3234cd32e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:25.541043 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-655f51de-3a27-4d56-a28b-76e3234cd32e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:25.541640 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-655f51de-3a27-4d56-a28b-76e3234cd32e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:25.708544 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:25.717057 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ff21c33f-88cf-4b49-a49a-4f1fd3d1db71 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.222449 Jul 04 09:18:25.718340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 213/431] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:25 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:25.722941 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:25.723608 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:25.730000 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:25.730565 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:25.731980 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:25.732625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:25.888926 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:25.896768 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d885f21d-457a-49a4-bd2e-06e7b5f8d653 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.177267 Jul 04 09:18:25.897345 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 214/432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:25 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:26.549251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-655f51de-3a27-4d56-a28b-76e3234cd32e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033183 Jul 04 09:18:26.551289 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 219/433] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:18:25 2022] POST /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments => generated 194 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:18:26.738576 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:26.739952 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:26.756142 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:26.756988 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:26.757998 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:26.760376 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:26.903364 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-41a088c4-c78e-49f4-a2fb-986caacc186d req-b54b72b6-9bf7-4f89-8117-ed64efa55311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4c41fd-607b-4420-9719-5e0b6a2f47f2", "name": "network-vif-plugged", "status": "completed", "tag": "a4e977c6-a145-4cde-899f-60464a853272"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:26.922192 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-41a088c4-c78e-49f4-a2fb-986caacc186d req-b54b72b6-9bf7-4f89-8117-ed64efa55311 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:26.925003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-41a088c4-c78e-49f4-a2fb-986caacc186d req-b54b72b6-9bf7-4f89-8117-ed64efa55311 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:26.961360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-41a088c4-c78e-49f4-a2fb-986caacc186d req-b54b72b6-9bf7-4f89-8117-ed64efa55311 service nova] Creating event network-vif-plugged:a4e977c6-a145-4cde-899f-60464a853272 for instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 on hv-cinder-81914 Jul 04 09:18:26.969541 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-41a088c4-c78e-49f4-a2fb-986caacc186d req-b54b72b6-9bf7-4f89-8117-ed64efa55311 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070107 Jul 04 09:18:26.973381 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 220/434] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:26.993498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:26.997337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:27.013032 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:27.029832 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:27.030735 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:27.031173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:27.147678 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:27.183177 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f896cb3-18cb-4136-92f6-8c7520fa9439 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.451025 Jul 04 09:18:27.227073 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 215/435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:26 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:27.343580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:27.351101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-52feea42-c1a8-4c3a-8b62-2562d96e4ac3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.376326 Jul 04 09:18:27.351671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 221/436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:26 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:28.212727 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:28.213992 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:28.220696 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:28.221138 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:28.222030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:28.222465 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:28.382137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:28.383536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:28.396037 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:28.396834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:28.397916 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:28.399865 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:28.513505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:28.524004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8a4be295-17fd-4022-8d8c-730a885c4cfc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.315006 Jul 04 09:18:28.525062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 216/437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:28 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:28.614373 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:28.630676 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b205846c-b46b-4d9f-8745-d03717b6e52d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.256791 Jul 04 09:18:28.631281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 222/438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:28 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:29.540748 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:29.541313 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:29.545004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:29.548892 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:29.549349 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:29.550137 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:29.550567 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:29.649571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:29.650486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:29.657763 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:29.658500 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:29.659570 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:29.660302 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:29.708575 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:29.717144 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cc814a8a-ec0c-4653-9c82-696c67a97faa tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.180346 Jul 04 09:18:29.727409 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 217/439] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:29 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:29.844715 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:29.844715 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a2cd8c3b-bd4e-4ecc-b253-e6a94033f5ed tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.198062 Jul 04 09:18:29.844715 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 223/440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:29 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:30.736380 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:30.737051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:30.745670 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:30.746644 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:30.747683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:30.748691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:30.860550 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:30.861437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:30.870028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:30.871713 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:30.881472 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:30.883489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:30.884136 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:31.004320 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:31.015442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-71e65fba-05b8-4864-a019-c7c3113c1285 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1266 microversion: 2.1 time: 0.282664 Jul 04 09:18:31.016331 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 218/441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:30 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:31.098909 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:31.107549 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f504ddb1-5adc-4f7f-abf5-c257d68388c9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1674 microversion: 2.1 time: 0.250653 Jul 04 09:18:31.108149 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 224/442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:30 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:32.035810 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:32.036773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:32.043674 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.044115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.045047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.045772 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.126781 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:32.128014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:32.137103 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.138220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.139418 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.140009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.259907 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:32.268191 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d2b3fc3c-08fa-48d2-9c49-0f9c278c8c42 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1454 microversion: 2.1 time: 0.236898 Jul 04 09:18:32.268979 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 219/443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:32 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1454 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:32.291874 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:32.292716 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:32.300037 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.300720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.301662 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.302290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.338574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:32.346396 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7b67326f-c42d-4179-a422-c3b23d207dbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1651 microversion: 2.1 time: 0.225001 Jul 04 09:18:32.358429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 225/444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:32 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1651 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:32.363042 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d6f506c4-1b51-4c0f-811b-23494b347433 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:32.369395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d6f506c4-1b51-4c0f-811b-23494b347433 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.369842 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d6f506c4-1b51-4c0f-811b-23494b347433 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.392456 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d6f506c4-1b51-4c0f-811b-23494b347433 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Going to try to start instance {{(pid=117795) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 09:18:32.449865 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d6f506c4-1b51-4c0f-811b-23494b347433 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action" status: 202 len: 0 microversion: 2.1 time: 0.090353 Jul 04 09:18:32.454252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 226/445] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:18:32 2022] POST /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:18:32.462116 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:32.462821 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:32.468906 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:32.469409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.469858 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.470781 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:32.471220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:32.480930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b163a059-2eff-4b76-8bce-6fec09e96d31 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1454 microversion: 2.1 time: 0.192822 Jul 04 09:18:32.494733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 220/446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:32 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:32.649793 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:32.664003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ef75fba4-9373-4c85-b3de-b464ab959cf3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1660 microversion: 2.1 time: 0.206263 Jul 04 09:18:32.673726 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 227/447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:32 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1660 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:33.681191 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:33.682118 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:33.692744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:33.693522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:33.694718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:33.695299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:34.311157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:34.312257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:34.321554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:34.321554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:34.322292 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:34.322720 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:34.341832 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:34.359271 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e132b783-12b5-49d7-a9fb-11367b411b7f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1660 microversion: 2.1 time: 0.681970 Jul 04 09:18:34.360445 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 221/448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:33 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1660 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:34.364943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lazy-loading 'flavor' on Instance uuid f404500c-0f77-4248-94bb-8d1eaf63a0bc {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:18:34.569548 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:34.600437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6b6cc81e-b4b4-41df-ade2-e4038c259939 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/action" status: 200 len: 32 microversion: 2.1 time: 0.293777 Jul 04 09:18:34.601397 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 228/449] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:18:34 2022] POST /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/action => generated 32 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 09:18:34.612546 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:34.615818 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:34.626099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:34.627051 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:34.628179 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:34.628759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:34.867240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:34.878469 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-53a6a909-6eec-45fd-8f15-9449ef3c1060 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.271355 Jul 04 09:18:34.880729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 222/450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:34 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:35.057661 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-68ad9c3b-92ba-440d-a5da-cfd1f85a55f2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Action: 'create', calling method: .version_select at 0x7f8e8108f3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1265907453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg7HneMHHh3iM6YXt5Z36L/V30nI0hXSRwImIbD/Qac96wgQ/hv6KDzhJ8O1Etlw4peaKPUiy6RMubPxLIEjt4mM999d4ePSp2wiNAAh3Lzjq9RVGfqk3mHyWZSrqSUdw=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:35.072800 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-68ad9c3b-92ba-440d-a5da-cfd1f85a55f2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Getting quotas for project 8a4eaafcb5814b92a0c740931fcf422d. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:18:35.076783 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-68ad9c3b-92ba-440d-a5da-cfd1f85a55f2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Getting quotas for user a9dfef8fef8d45d99636579271c71d51 and project 8a4eaafcb5814b92a0c740931fcf422d. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:18:35.102120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-68ad9c3b-92ba-440d-a5da-cfd1f85a55f2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048513 Jul 04 09:18:35.102772 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 229/451] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:18:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:35.169115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-742507844", "imageRef": "30d4480e-429d-40a4-b829-f4bd843889f4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1265907453", "networks": [{"uuid": "8b6d10a0-ee48-4dc7-8a9e-1260279cda9b"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:35.221417 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] validate_networks() for [('8b6d10a0-ee48-4dc7-8a9e-1260279cda9b', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:18:35.377725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:35.378479 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:35.386198 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:35.386792 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:35.387961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:35.388457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:35.692981 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:35.702409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f54fcc08-f8e9-4c37-9c90-049d5f36080b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1660 microversion: 2.1 time: 0.329093 Jul 04 09:18:35.712520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 230/452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:35 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1660 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:35.719553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:35.720350 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:35.727288 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:35.728008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:35.728957 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:35.729551 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:35.849372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lazy-loading 'services' on Instance uuid 358be5c2-4340-47e3-a20d-ad976781f649 {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:18:35.962609 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-959e4938-8a80-432b-882b-58978e7b9577 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "DELETE /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649/os-volume_attachments/1516b3da-7394-4f25-8f6d-a2bd257aadfb" status: 202 len: 0 microversion: 2.1 time: 0.241014 Jul 04 09:18:35.962609 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 231/453] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:18:35 2022] DELETE /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649/os-volume_attachments/1516b3da-7394-4f25-8f6d-a2bd257aadfb => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:18:35.964635 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:35.965489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:35.973904 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:35.974468 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:35.975325 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:35.975825 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:36.199238 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:18:36.200494 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:18:36.200973 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:18:36.201392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:18:36.201793 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:18:36.211253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:36.211703 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:36.212449 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:36.213174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:36.231919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Getting quotas for project 8a4eaafcb5814b92a0c740931fcf422d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:18:36.236500 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Getting quotas for user a9dfef8fef8d45d99636579271c71d51 and project 8a4eaafcb5814b92a0c740931fcf422d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:18:36.244542 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:36.248278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:18:36.250706 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30d4480e-429d-40a4-b829-f4bd843889f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:18:36.254364 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ef103d2c-d8eb-461f-81b2-9a93f7fd8dd3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.294365 Jul 04 09:18:36.255453 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 232/454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:35 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:36.260644 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-fa057ead-a14f-4cee-b467-38e12f60089d req-f0b3d2ab-91b9-4f0d-8940-04298a7eca7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4c41fd-607b-4420-9719-5e0b6a2f47f2", "tag": "a4e977c6-a145-4cde-899f-60464a853272"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:36.273457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-fa057ead-a14f-4cee-b467-38e12f60089d req-f0b3d2ab-91b9-4f0d-8940-04298a7eca7f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:36.274059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-fa057ead-a14f-4cee-b467-38e12f60089d req-f0b3d2ab-91b9-4f0d-8940-04298a7eca7f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:36.286607 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-fa057ead-a14f-4cee-b467-38e12f60089d req-f0b3d2ab-91b9-4f0d-8940-04298a7eca7f service nova] Creating event network-changed:a4e977c6-a145-4cde-899f-60464a853272 for instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 on hv-cinder-81914 Jul 04 09:18:36.293030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-fa057ead-a14f-4cee-b467-38e12f60089d req-f0b3d2ab-91b9-4f0d-8940-04298a7eca7f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035816 Jul 04 09:18:36.293862 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 233/455] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:36.309059 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f0f63ca9-5a1a-4e53-b5ac-53e0899e4f10 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143733 Jul 04 09:18:36.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 223/456] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:18:36.322241 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ad48f5a8-dc88-43e4-aaa4-c37f5ebd4221 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:36.323658 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ad48f5a8-dc88-43e4-aaa4-c37f5ebd4221 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:36.383135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ad48f5a8-dc88-43e4-aaa4-c37f5ebd4221 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:36.390804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ad48f5a8-dc88-43e4-aaa4-c37f5ebd4221 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1258 microversion: 2.1 time: 0.072667 Jul 04 09:18:36.391617 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 234/457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:36 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:36.720221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:36.720881 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:36.749555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:36.750151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:36.751180 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:36.751826 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:36.908488 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:36.916498 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-480e41a1-ec59-4829-bc03-d92573a55a00 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1664 microversion: 2.1 time: 0.200358 Jul 04 09:18:36.917728 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 224/458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:36 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1664 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:37.090106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:37.091192 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:37.098259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.098972 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.099918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.100512 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.127879 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:18:37.207950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-03824e6c-20d9-4df9-a65b-24d4db1876cf tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "DELETE /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 204 len: 0 microversion: 2.1 time: 0.121336 Jul 04 09:18:37.208836 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 235/459] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:18:37 2022] DELETE /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:18:37.217650 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:37.218339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:37.225456 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.225825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.226651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.227076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.273256 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:37.273983 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:37.279925 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.280362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.281112 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.281539 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.396974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:37.405983 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fb74f351-4712-4515-b02c-784c52222042 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1512 microversion: 2.1 time: 0.192771 Jul 04 09:18:37.406561 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 225/460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:37 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:37.412672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:37.413477 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:37.422515 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.422956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.423976 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:37.424579 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:37.445594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:37.454316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5b6b9d78-3488-4011-af3e-a7ece51f43a3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.185514 Jul 04 09:18:37.455425 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 236/461] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:37 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:37.491586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:37.499206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91a64947-64d5-4c41-b762-8ba3481119aa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1310 microversion: 2.1 time: 0.091696 Jul 04 09:18:37.499780 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 226/462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:37 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:38.423736 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:38.424347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:38.431269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:38.431726 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:38.432490 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:38.432927 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:38.472045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:38.473796 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:38.481451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:38.481914 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:38.482707 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:38.483137 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:38.611612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:38.619350 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a2cfaaae-ba8f-4795-be3b-7d7b07b2e770 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1512 microversion: 2.1 time: 0.199486 Jul 04 09:18:38.619891 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 237/463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:38 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:38.624730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:38.625493 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:38.632023 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:38.632387 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:38.633178 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:38.633604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:38.643681 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:38.652022 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5682b61b-cf5d-4afa-9699-ffc132f43abc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.183839 Jul 04 09:18:38.652599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 227/464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:38 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:38.694856 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:38.702378 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bfd8c15c-ea6f-4a68-ab0f-fe3d29fdcefa tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1318 microversion: 2.1 time: 0.081479 Jul 04 09:18:38.702938 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 238/465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:38 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1318 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:39.638387 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:39.640044 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:39.654799 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:39.656334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:39.660668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:39.662263 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:39.674204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:39.675285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:39.698567 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:39.699301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:39.700277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:39.701104 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:39.923225 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:39.942659 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a5a43019-c034-4b73-9ff0-1daefa16a58b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.309488 Jul 04 09:18:39.943912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 228/466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:39 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:39.949245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:39.955682 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:39.984999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:39.989790 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:39.998278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:39.998278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:40.002353 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:40.155507 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:40.169837 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-353b586d-8468-4a8b-a802-8f52e6deb969 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.502786 Jul 04 09:18:40.170475 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 239/467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:39 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:40.182147 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-c20d258d-4280-4965-9204-9dd9733c7a72 req-23b0cff1-00dd-476d-bc93-87af134ce7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358be5c2-4340-47e3-a20d-ad976781f649", "name": "network-vif-deleted", "tag": "b19eada3-7e7e-48e2-8cec-6d47b629d0f6"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:40.206695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c20d258d-4280-4965-9204-9dd9733c7a72 req-23b0cff1-00dd-476d-bc93-87af134ce7ea service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:40.209782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c20d258d-4280-4965-9204-9dd9733c7a72 req-23b0cff1-00dd-476d-bc93-87af134ce7ea service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:40.246530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-c20d258d-4280-4965-9204-9dd9733c7a72 req-23b0cff1-00dd-476d-bc93-87af134ce7ea service nova] Creating event network-vif-deleted:b19eada3-7e7e-48e2-8cec-6d47b629d0f6 for instance 358be5c2-4340-47e3-a20d-ad976781f649 on hv-cinder-81914 Jul 04 09:18:40.259299 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-c20d258d-4280-4965-9204-9dd9733c7a72 req-23b0cff1-00dd-476d-bc93-87af134ce7ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086858 Jul 04 09:18:40.263465 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:40.276550 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 240/468] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:40.279222 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b02cbf51-3a77-4e5b-ad3a-988a1904b9c1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.331972 Jul 04 09:18:40.290085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 229/469] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:39 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:40.961926 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:40.962902 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:40.969762 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:40.970250 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:40.971023 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:40.971519 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:41.037079 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:41.045051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2058e907-83de-4c95-914a-5e0738e88449 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.087959 Jul 04 09:18:41.045628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 241/470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:40 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:41.187432 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:41.188175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:41.195316 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:41.195757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:41.196708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:41.197137 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:41.296806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:41.298668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:41.309708 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:41.310584 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:41.311366 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:41.311950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:41.332429 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:41.341961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b47addcc-97ca-4a3c-ad80-e0f157f10d5f tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.158436 Jul 04 09:18:41.351947 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 230/471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:41 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:41.459520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:41.467549 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-90042359-91c6-44fe-99dd-646ab1116bb8 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.174542 Jul 04 09:18:41.468303 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 242/472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:41 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:42.062390 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:42.063005 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:42.069579 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:42.070033 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:42.081775 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:42.081775 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:42.140151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:42.148431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7cf3b05a-8a4a-49b0-b8ba-196c572dc14a tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.089759 Jul 04 09:18:42.149338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 231/473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:42 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:42.359890 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:42.360610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:42.367777 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:42.368216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:42.368985 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:42.369411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:42.485013 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:42.486353 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:42.494439 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:42.495381 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:42.496163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:42.496596 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:42.511393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:42.522400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-768f3e9b-e449-47c5-b2c6-6364a8954c2e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.166464 Jul 04 09:18:42.523330 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 243/474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:42 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:42.649172 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:42.656806 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2e1fafeb-63eb-4b10-b979-7e29d5976427 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.176147 Jul 04 09:18:42.657365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 232/475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:42 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:43.166402 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:43.167088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:43.173588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:43.175301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:43.176125 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:43.176806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:43.243988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:43.253376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ebc9e53a-762d-4b49-b4e0-554dde0cae63 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.090955 Jul 04 09:18:43.254002 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 244/476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:43 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:43.540755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:43.541558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:43.548353 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:43.548800 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:43.549565 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:43.550027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:43.675046 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:43.675701 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:43.682861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:43.683455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:43.684272 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:43.684827 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:43.692941 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:43.701156 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9041ace6-e906-4dbf-bebe-9d98bcb4a599 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.164316 Jul 04 09:18:43.701731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 233/477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:43 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:43.826238 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:43.835310 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a0629198-ccd7-41ac-9cba-e7f17f347be6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.162862 Jul 04 09:18:43.835310 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 245/478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:43 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:44.271571 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:44.272163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:44.278762 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:44.279228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:44.280020 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:44.280511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:44.343872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:44.351981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cb579c9a-05ae-4616-86f3-70a8ca77cbcb tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.084433 Jul 04 09:18:44.352528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 234/479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:44 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:44.719809 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:44.720433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:44.727092 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:44.727540 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:44.728316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:44.728748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:44.734089 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:44.851513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:44.852171 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:44.858919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:44.859389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:44.860338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:44.860787 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:44.872834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:44.882677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-cfad0635-22d8-4813-8835-e41e909abcd0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.167648 Jul 04 09:18:44.892980 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 246/480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:44 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:44.996629 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:45.004573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a5d76b87-c7c1-4cef-a93f-e6364e371ef1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.157259 Jul 04 09:18:45.005332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 235/481] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:44 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:45.369860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:45.370662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:45.377459 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:45.377930 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:45.378780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:45.379322 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:45.446087 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:45.453837 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ab70f290-24a8-4425-ba94-b84fea43da53 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.087996 Jul 04 09:18:45.454450 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 247/482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:45 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:45.900505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:45.901173 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:45.912860 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:45.913777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:45.915169 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:45.915812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:46.022331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:46.022955 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:46.030868 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:46.031490 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:46.032346 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:46.032784 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:46.074657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:46.083368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-31d23152-4e8c-4645-97d5-535c9e43138c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.186835 Jul 04 09:18:46.084165 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 236/483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:45 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:46.189105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:46.197644 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dfedf487-ebc0-45ec-90eb-dcde6fd4a78a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.180706 Jul 04 09:18:46.198375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 248/484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:46 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:46.472716 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:46.473351 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:46.475299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:46.476181 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:46.482340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:46.482785 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:46.483592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:46.484025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:46.552624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:46.560654 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b7e31317-4199-47d8-8813-6a4130d3f793 tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.091716 Jul 04 09:18:46.561227 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 237/485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:46 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:47.101018 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:47.102970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:47.108861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:47.112053 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:47.112807 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:47.113785 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:47.114281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:47.214842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:47.216092 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:47.223199 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:47.223917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:47.225034 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:47.225674 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:47.283461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:47.292601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-50b3f374-2e00-4862-8e1d-2c748308a3cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.195766 Jul 04 09:18:47.300783 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 249/486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:47 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:47.367341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:47.375239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-852e274b-4775-4754-8e2d-60118aea3313 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.164172 Jul 04 09:18:47.375963 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 238/487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:47 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:47.578048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:47.578669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:47.585901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:47.586368 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:47.587147 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:47.587583 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:47.656505 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:47.669569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-002f57c3-9ab1-443f-b1e3-427e47b0356b tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1470 microversion: 2.1 time: 0.095236 Jul 04 09:18:47.671134 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 250/488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:47 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1470 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:48.319068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:48.319729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:48.326557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:48.327025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:48.327777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:48.328217 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:48.392492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:48.393105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:48.399695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:48.400140 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:48.400915 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:48.401327 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:48.507802 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:48.516704 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-553fbdde-7d4e-45ca-8eaa-dfe40f5fb5f3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.202617 Jul 04 09:18:48.517288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 239/489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:48 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:48.553513 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:48.561519 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c0c89d73-be7a-4d94-ab5c-b55e6f864444 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.173235 Jul 04 09:18:48.562203 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 251/490] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:48 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:48.687438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:48.688042 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:48.694431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:48.694872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:48.695620 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:48.696045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:48.767020 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ebb8aa3b7146e4a34a565969154f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec91e0c883943448c9d0e8d4d5e09ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:48.776331 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-97ec4730-93d6-435d-b7c3-66b6834b2a3d tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 200 len: 1303 microversion: 2.1 time: 0.092867 Jul 04 09:18:48.776996 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 240/491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:48 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:49.332787 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-1d64450f-be3a-44e3-b77d-c43448ce155d req-2e4e0466-be7a-4daf-ad62-8cc80cec853f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c9e64-950f-4aa9-bd4d-2304226516fb", "tag": "37f23b60-3209-44f8-8d9b-bff327f40798"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:49.341671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1d64450f-be3a-44e3-b77d-c43448ce155d req-2e4e0466-be7a-4daf-ad62-8cc80cec853f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:49.342400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1d64450f-be3a-44e3-b77d-c43448ce155d req-2e4e0466-be7a-4daf-ad62-8cc80cec853f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:49.358049 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-1d64450f-be3a-44e3-b77d-c43448ce155d req-2e4e0466-be7a-4daf-ad62-8cc80cec853f service nova] Creating event network-changed:37f23b60-3209-44f8-8d9b-bff327f40798 for instance 398c9e64-950f-4aa9-bd4d-2304226516fb on hv-cinder-81914 Jul 04 09:18:49.364106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-1d64450f-be3a-44e3-b77d-c43448ce155d req-2e4e0466-be7a-4daf-ad62-8cc80cec853f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035392 Jul 04 09:18:49.365864 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 252/492] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:49.535074 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:49.536765 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:49.543175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:49.543610 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:49.544368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:49.544825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:49.579578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:49.580472 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:49.587898 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:49.588460 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:49.589311 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:49.589814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:49.728337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:49.736981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd33307c-c753-4b68-9850-bab527ff23bf tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.205899 Jul 04 09:18:49.737566 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 241/493] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:49 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:49.758634 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:49.767369 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9c3b47d6-dce1-4dba-8d60-0afeed2718a2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.191753 Jul 04 09:18:49.768142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 253/494] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:49 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:49.794224 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:49.794883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] [instance: 358be5c2-4340-47e3-a20d-ad976781f649] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:49.801059 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:49.802157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:49.802931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:49.803366 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:49.816742 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] HTTP exception thrown: Instance 358be5c2-4340-47e3-a20d-ad976781f649 could not be found. Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Request method failure captured: Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 HTTP/1.1 Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq_0bliJMTDmN0dBX5PpSmCltuhRz7W_TSfjAa7sumraahzlrn6pNRSnVv6-jzSjKpSnZQZJ6IH8G3JznLpgqqGq9iPDnm-SPPmiDSd9EAv2RhuKUFPH6ayIdWVsotKugM1RB5D-GV7BghUZuSXTAHYTnuyHC3POYt2m0ENUUBF54Jw Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: fec91e0c883943448c9d0e8d4d5e09ae Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1605507432 Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:18:49.818922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fec91e0c883943448c9d0e8d4d5e09ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fec91e0c883943448c9d0e8d4d5e09ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fec91e0c883943448c9d0e8d4d5e09ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fec91e0c883943448c9d0e8d4d5e09ae"}]}] Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesSnapshotTestJSON-1605507432 Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: fec91e0c883943448c9d0e8d4d5e09ae Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1605507432 Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesSnapshotTestJSON-1605507432-project Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: c0ebb8aa3b7146e4a34a565969154f9a Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesSnapshotTestJSON-1605507432-project Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 358be5c2-4340-47e3-a20d-ad976781f649 could not be found. Jul 04 09:18:49.820554 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': '358be5c2-4340-47e3-a20d-ad976781f649'} Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358be5c2-4340-47e3-a20d-ad976781f649 could not be found. Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:18:49.821368 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358be5c2-4340-47e3-a20d-ad976781f649 could not be found. Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358be5c2-4340-47e3-a20d-ad976781f649 could not be found. Jul 04 09:18:49.822661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:49.823744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] Returning 404 to user: Instance 358be5c2-4340-47e3-a20d-ad976781f649 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:18:49.823744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b55fd441-26cd-43f5-9383-202d1580254e tempest-VolumesSnapshotTestJSON-1605507432 tempest-VolumesSnapshotTestJSON-1605507432-project] 10.222.0.26 "GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649" status: 404 len: 111 microversion: 2.1 time: 0.030499 Jul 04 09:18:49.823744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 242/495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:49 2022] GET /compute/v2.1/servers/358be5c2-4340-47e3-a20d-ad976781f649 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:18:50.759560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:50.760424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:50.772815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:50.773560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:50.775050 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:50.775866 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:50.787733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:50.788475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:50.795371 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:50.795960 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:50.796875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:50.797396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:51.025507 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:51.028581 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:51.037086 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cccd9158-7fbc-44d9-a887-e071164e4c56 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.255033 Jul 04 09:18:51.037665 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 243/496] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:50 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:51.045217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ae64c998-5b7d-4c0e-b1c7-1db9627f160b tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.293144 Jul 04 09:18:51.045956 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 254/497] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:50 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:52.056229 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:52.056978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:52.063440 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:52.064164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:52.065030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:52.065555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:52.066471 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:52.067031 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:52.071352 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:52.071816 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:52.072578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:52.073011 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:52.269481 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:52.272494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:52.277272 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0ba1588-8dc3-4edb-b05e-6e3c526c247b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.225648 Jul 04 09:18:52.277807 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 244/498] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:52 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:52.280659 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-900dc0a4-e092-469f-9bdd-0862ddd607c8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.221708 Jul 04 09:18:52.281269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 255/499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:52 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:53.296981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:53.297871 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:53.301069 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:53.301710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:53.305913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:53.306400 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:53.307158 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:53.307620 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:53.309197 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:53.309652 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:53.310452 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:53.310880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:53.505748 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:53.508702 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:53.514849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c9722531-286e-49d1-9959-2f6565797ddd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.223666 Jul 04 09:18:53.515639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 245/500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:53 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:53.517399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-54517b99-86ce-4159-89e7-8a2b70bfde98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.222262 Jul 04 09:18:53.522277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 256/501] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:53 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:54.532750 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:54.533553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:54.535551 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:54.536292 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:54.540810 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:54.541250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:54.542710 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:54.542933 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:54.543175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:54.543476 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:54.544239 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:54.544663 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:54.563534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:54.747919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:54.751094 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:54.755813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7673a433-a0d8-4887-8a32-e73c948f6c8c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.226893 Jul 04 09:18:54.756441 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 246/502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:54 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:54.759136 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0758e86b-762e-47d9-8e0a-632799ef4e76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.227635 Jul 04 09:18:54.759701 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 257/503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:54 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:55.776279 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:55.779443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:55.780159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:55.783033 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:55.792017 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:55.792237 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:55.792467 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:55.792999 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:55.793243 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:55.793733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:55.794117 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:55.794852 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:55.995405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:56.003424 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e709515f-2b7a-42cc-8446-28f48d9b5dab tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.230946 Jul 04 09:18:56.004361 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 258/504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:55 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:56.006789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:56.014978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-301a8cfc-9080-475f-be53-90ed5be9f95b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.245934 Jul 04 09:18:56.015546 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 247/505] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:55 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:56.713006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-a828a50d-549c-4ab3-9326-c4bbb10d1c25 req-d87bc4b5-9c17-4522-af33-1b22c5929c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398c9e64-950f-4aa9-bd4d-2304226516fb", "name": "network-vif-plugged", "status": "completed", "tag": "37f23b60-3209-44f8-8d9b-bff327f40798"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:56.721613 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-a828a50d-549c-4ab3-9326-c4bbb10d1c25 req-d87bc4b5-9c17-4522-af33-1b22c5929c40 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:56.722224 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-a828a50d-549c-4ab3-9326-c4bbb10d1c25 req-d87bc4b5-9c17-4522-af33-1b22c5929c40 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:56.737082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-a828a50d-549c-4ab3-9326-c4bbb10d1c25 req-d87bc4b5-9c17-4522-af33-1b22c5929c40 service nova] Creating event network-vif-plugged:37f23b60-3209-44f8-8d9b-bff327f40798 for instance 398c9e64-950f-4aa9-bd4d-2304226516fb on hv-cinder-81914 Jul 04 09:18:56.742052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-a828a50d-549c-4ab3-9326-c4bbb10d1c25 req-d87bc4b5-9c17-4522-af33-1b22c5929c40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032775 Jul 04 09:18:56.742680 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 259/506] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:18:57.021337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:57.022126 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:57.029924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:57.030489 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:57.031526 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:57.031948 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:57.038363 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:57.040607 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:57.051842 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:57.053338 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:57.054909 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:57.055492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:57.262448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:57.272061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-588d0c1f-ad5d-4653-8ac5-8f61e7a098fa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1735 microversion: 2.1 time: 0.255059 Jul 04 09:18:57.272874 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 248/507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:57 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:57.305577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:57.314563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-83ee98b8-4290-4589-86fd-11a86d5e1780 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.285871 Jul 04 09:18:57.315137 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 260/508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:57 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:58.289684 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:58.291083 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:58.297522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.298004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.298775 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.299208 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.333486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:58.335345 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:58.342944 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.343738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.344725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.345361 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.495645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:58.504113 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd078f87-617f-4603-a2ad-3b4d417d2146 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1715 microversion: 2.1 time: 0.218709 Jul 04 09:18:58.504671 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 249/509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:58 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1715 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:58.536780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:58.544608 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-700693d5-52c4-48fd-8590-9fd30060e6e2 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1358 microversion: 2.1 time: 0.217084 Jul 04 09:18:58.545178 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 261/510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:58 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:18:58.612099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:58.612600 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:58.619143 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.619516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.620270 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.620699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.747136 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] HTTP exception thrown: Cannot 'detach_volume' instance f404500c-0f77-4248-94bb-8d1eaf63a0bc while it is in vm_state rescued Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Request method failure captured: Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments/31c9b1a1-a892-492d-b422-b47cad7da0d1 HTTP/1.1 Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-OmtcNhVqntRlyIJLc3i65jC9RnMZJxWJq6ip8ODRno-ES3hTRMNX1nVDJhcIj2eLLKlqBYLLGPpwZFZa0dvMfRnfnNpiSvpsx2tdP6Qp76HuIKnsEPgum2S9fpT5PoOZ830fcCeV8ULI8q_N0FJ-gJrrtFKqql9PSwROWs13s4vM Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:18:58.748624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_48690ebc49824572a08f53597eeee661", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/48690ebc49824572a08f53597eeee661"}]}] Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 1e916bf18efe421895c8d7b28fcd55d5 Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:18:58.750030 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Cannot 'detach_volume' instance f404500c-0f77-4248-94bb-8d1eaf63a0bc while it is in vm_state rescued Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'server_id': 'f404500c-0f77-4248-94bb-8d1eaf63a0bc', 'id': '31c9b1a1-a892-492d-b422-b47cad7da0d1'} Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f404500c-0f77-4248-94bb-8d1eaf63a0bc in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:18:58.750720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f404500c-0f77-4248-94bb-8d1eaf63a0bc while it is in vm_state rescued Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f404500c-0f77-4248-94bb-8d1eaf63a0bc while it is in vm_state rescued Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:18:58.752061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Returning 409 to user: Cannot 'detach_volume' instance f404500c-0f77-4248-94bb-8d1eaf63a0bc while it is in vm_state rescued {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:18:58.753317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-369f08c1-df54-4ecd-bd65-b31eaa8500e3 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments/31c9b1a1-a892-492d-b422-b47cad7da0d1" status: 409 len: 152 microversion: 2.1 time: 0.141927 Jul 04 09:18:58.753317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 250/511] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:18:58 2022] DELETE /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments/31c9b1a1-a892-492d-b422-b47cad7da0d1 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 09:18:58.759879 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e3b42fa6-cdaa-475b-a18c-2533025a364c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:18:58.760408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e3b42fa6-cdaa-475b-a18c-2533025a364c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:58.767419 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3b42fa6-cdaa-475b-a18c-2533025a364c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.767847 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3b42fa6-cdaa-475b-a18c-2533025a364c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.768629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3b42fa6-cdaa-475b-a18c-2533025a364c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.769056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3b42fa6-cdaa-475b-a18c-2533025a364c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.840723 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e3b42fa6-cdaa-475b-a18c-2533025a364c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "POST /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/action" status: 202 len: 0 microversion: 2.1 time: 0.084870 Jul 04 09:18:58.841549 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 262/512] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:18:58 2022] POST /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:18:58.852628 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:58.853276 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:58.860103 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.860548 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.861297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:58.861733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:58.998834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:59.006747 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d629b73e-992d-4a29-89e3-3954b33700ea tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1723 microversion: 2.1 time: 0.158887 Jul 04 09:18:59.007298 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 251/513] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:58 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:59.563340 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:59.564028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:59.571932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:59.572367 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:59.573342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:59.574003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:59.601399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.793987 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:18:59.804052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-38afd7b6-b4e4-48e5-a986-4b3df6024940 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1548 microversion: 2.1 time: 0.246032 Jul 04 09:18:59.804531 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 263/514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:59 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:18:59.823181 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:18:59.823787 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:18:59.826130 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.831510 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:59.832118 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:59.832873 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:59.833295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:00.024480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:00.024828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:00.025437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:00.031811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:00.032371 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-30177335-201c-471a-9392-19225f6bf8f0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1548 microversion: 2.1 time: 0.213804 Jul 04 09:19:00.032513 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:00.032909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 252/515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:18:59 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:00.033598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:00.033900 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:00.048056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:00.051712 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:00.052588 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Searching by: {'deleted': False, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d'} {{(pid=117793) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 04 09:19:00.059448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:00.059919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:00.060707 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:00.061135 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:00.151299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.multi_cell_list [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 04 09:19:00.172849 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:00.180908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3295dda6-979c-4990-8bc1-9933bfdfdffa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1723 microversion: 2.1 time: 0.160281 Jul 04 09:19:00.181679 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 264/516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:00 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:00.246290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8af401fa-c3af-4335-9fd8-80452319c2f4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201683 Jul 04 09:19:00.246799 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 253/517] 10.222.0.26 () {58 vars in 1124 bytes} [Mon Jul 4 09:19:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:00.260268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:00.260888 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:00.262749 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:00.268437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:00.268884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:00.269641 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:00.270106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:00.405444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:00.415606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d83c2813-4460-42f4-bac1-d5634c451aee tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1548 microversion: 2.1 time: 0.159442 Jul 04 09:19:00.416188 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 265/518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:00 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:01.200335 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:01.201134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:01.210287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:01.210880 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:01.211882 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:01.212451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:01.350516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:01.358658 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-46a86a18-9cee-43c6-8a6a-ffde7bcb8836 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1723 microversion: 2.1 time: 0.163887 Jul 04 09:19:01.359220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 254/519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:01 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:02.380413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:02.381398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:02.393172 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:02.393962 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:02.395196 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:02.395904 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:02.532235 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:02.542457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7d547556-00dc-4fb8-ae5b-d3341fdc9c79 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1723 microversion: 2.1 time: 0.168504 Jul 04 09:19:02.543031 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 266/520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:02 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:03.563578 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:03.564455 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:03.573306 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:03.573762 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:03.574533 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:03.574961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:03.719158 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:03.727430 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-30690224-829a-472d-9120-b1373b09dd38 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1723 microversion: 2.1 time: 0.170398 Jul 04 09:19:03.728241 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 255/521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:03 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:04.088109 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e9ccde7f-3b88-4546-a6ab-4e1ba85b694f tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "235f9c52-c036-435b-945d-dda33891b531"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:04.089521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e9ccde7f-3b88-4546-a6ab-4e1ba85b694f tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:04.096205 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e9ccde7f-3b88-4546-a6ab-4e1ba85b694f tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:04.096725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e9ccde7f-3b88-4546-a6ab-4e1ba85b694f tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:04.097560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e9ccde7f-3b88-4546-a6ab-4e1ba85b694f tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:04.098148 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e9ccde7f-3b88-4546-a6ab-4e1ba85b694f tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:04.561020 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e9ccde7f-3b88-4546-a6ab-4e1ba85b694f tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477361 Jul 04 09:19:04.561904 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 267/522] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:19:04 2022] POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:04.745737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:04.746287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:04.753986 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:04.754419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:04.755237 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:04.755711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:04.901755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:04.909819 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-36cc68f9-9b18-4027-840e-56ae45f58efa tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1723 microversion: 2.1 time: 0.168822 Jul 04 09:19:04.910417 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 256/523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:04 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:05.931181 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:05.931879 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:05.938902 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:05.939348 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:05.940126 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:05.940557 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:06.091432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:06.099735 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-23543aca-b8c5-4d08-8aa6-1bf2c919d433 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1729 microversion: 2.1 time: 0.173970 Jul 04 09:19:06.100419 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 268/524] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:05 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:06.120053 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9fa27789-80d8-4e3e-933e-d5426de42de7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:06.120839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9fa27789-80d8-4e3e-933e-d5426de42de7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:06.128228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa27789-80d8-4e3e-933e-d5426de42de7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:06.128676 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa27789-80d8-4e3e-933e-d5426de42de7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:06.129451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa27789-80d8-4e3e-933e-d5426de42de7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:06.129915 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa27789-80d8-4e3e-933e-d5426de42de7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:06.214038 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9fa27789-80d8-4e3e-933e-d5426de42de7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101110 Jul 04 09:19:06.214610 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 257/525] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:19:06 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:07.107115 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-391f5b42-0132-4b85-b6a2-bb7e22f7b7d8 req-13b5c9d3-eed9-4e7d-b604-3d47de21e0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f404500c-0f77-4248-94bb-8d1eaf63a0bc", "tag": "0cb1b91f-f4e7-4260-86d4-761589933b09"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:07.115690 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-391f5b42-0132-4b85-b6a2-bb7e22f7b7d8 req-13b5c9d3-eed9-4e7d-b604-3d47de21e0e9 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:07.116130 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-391f5b42-0132-4b85-b6a2-bb7e22f7b7d8 req-13b5c9d3-eed9-4e7d-b604-3d47de21e0e9 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:07.127640 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-391f5b42-0132-4b85-b6a2-bb7e22f7b7d8 req-13b5c9d3-eed9-4e7d-b604-3d47de21e0e9 service nova] Creating event network-changed:0cb1b91f-f4e7-4260-86d4-761589933b09 for instance f404500c-0f77-4248-94bb-8d1eaf63a0bc on hv-cinder-81914 Jul 04 09:19:07.134388 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-391f5b42-0132-4b85-b6a2-bb7e22f7b7d8 req-13b5c9d3-eed9-4e7d-b604-3d47de21e0e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030180 Jul 04 09:19:07.135211 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 269/526] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:09.153122 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-7757744b-c733-4faa-bde9-5a3c97988bda req-de0e1c5b-6a87-45d8-8932-41cb8215a0eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f404500c-0f77-4248-94bb-8d1eaf63a0bc", "tag": "0cb1b91f-f4e7-4260-86d4-761589933b09"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:09.161578 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7757744b-c733-4faa-bde9-5a3c97988bda req-de0e1c5b-6a87-45d8-8932-41cb8215a0eb service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:09.162060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7757744b-c733-4faa-bde9-5a3c97988bda req-de0e1c5b-6a87-45d8-8932-41cb8215a0eb service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:09.173007 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-7757744b-c733-4faa-bde9-5a3c97988bda req-de0e1c5b-6a87-45d8-8932-41cb8215a0eb service nova] Creating event network-changed:0cb1b91f-f4e7-4260-86d4-761589933b09 for instance f404500c-0f77-4248-94bb-8d1eaf63a0bc on hv-cinder-81914 Jul 04 09:19:09.178411 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-7757744b-c733-4faa-bde9-5a3c97988bda req-de0e1c5b-6a87-45d8-8932-41cb8215a0eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029526 Jul 04 09:19:09.179292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 258/527] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:12.126061 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:12.126766 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:12.133430 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:12.133873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:12.134668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:12.135122 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:12.277464 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:12.285956 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e02f8b2d-01c2-4ca1-b38d-a836e8a0fca0 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1594 microversion: 2.1 time: 0.164625 Jul 04 09:19:12.286574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 270/528] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:12 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:14.424482 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-b2673a5a-e3c6-4e03-8e43-66725dd3c2a7 req-c310c7ad-4543-482e-a2d8-4ef31593d532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c9e64-950f-4aa9-bd4d-2304226516fb", "tag": "37f23b60-3209-44f8-8d9b-bff327f40798"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:14.439314 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:14.443199 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b2673a5a-e3c6-4e03-8e43-66725dd3c2a7 req-c310c7ad-4543-482e-a2d8-4ef31593d532 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:14.443929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b2673a5a-e3c6-4e03-8e43-66725dd3c2a7 req-c310c7ad-4543-482e-a2d8-4ef31593d532 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:14.460173 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-b2673a5a-e3c6-4e03-8e43-66725dd3c2a7 req-c310c7ad-4543-482e-a2d8-4ef31593d532 service nova] Creating event network-changed:37f23b60-3209-44f8-8d9b-bff327f40798 for instance 398c9e64-950f-4aa9-bd4d-2304226516fb on hv-cinder-81914 Jul 04 09:19:14.468350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-b2673a5a-e3c6-4e03-8e43-66725dd3c2a7 req-c310c7ad-4543-482e-a2d8-4ef31593d532 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049639 Jul 04 09:19:14.470064 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 259/529] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:15.830851 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-676454316"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:15.837975 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:15.845265 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:15.845727 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:15.846499 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:15.846932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:15.988418 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.network.security_group_api [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Adding security group 69f80a40-3050-44fd-93d7-3f174d50ae61 to port 37f23b60-3209-44f8-8d9b-bff327f40798 Jul 04 09:19:16.377249 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-de41630b-eeb8-44e2-a4fb-303b686d757d tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/action" status: 202 len: 0 microversion: 2.1 time: 0.549896 Jul 04 09:19:16.377912 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 271/530] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:19:15 2022] POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:19:16.388317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:16.390843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:16.402474 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:16.402931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:16.403801 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:16.404212 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:16.486054 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-7f166c0b-a18e-4866-b3ed-13c0e37412fe req-8cd94f2e-7226-4c1f-ae5c-1ae750bd0ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c9e64-950f-4aa9-bd4d-2304226516fb", "tag": "37f23b60-3209-44f8-8d9b-bff327f40798"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:16.495078 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-7f166c0b-a18e-4866-b3ed-13c0e37412fe req-8cd94f2e-7226-4c1f-ae5c-1ae750bd0ebf service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:16.495894 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-7f166c0b-a18e-4866-b3ed-13c0e37412fe req-8cd94f2e-7226-4c1f-ae5c-1ae750bd0ebf service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:16.509371 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-7f166c0b-a18e-4866-b3ed-13c0e37412fe req-8cd94f2e-7226-4c1f-ae5c-1ae750bd0ebf service nova] Creating event network-changed:37f23b60-3209-44f8-8d9b-bff327f40798 for instance 398c9e64-950f-4aa9-bd4d-2304226516fb on hv-cinder-81914 Jul 04 09:19:16.515393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-7f166c0b-a18e-4866-b3ed-13c0e37412fe req-8cd94f2e-7226-4c1f-ae5c-1ae750bd0ebf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032790 Jul 04 09:19:16.516432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 272/531] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:19:16.620607 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:16.629213 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5cb83ee4-2e02-4ad7-aa82-c5e160f3a304 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1759 microversion: 2.1 time: 0.245818 Jul 04 09:19:16.629866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 260/532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:16 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1759 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:40.156412 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=15 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:40.156834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:40.163182 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3e70b9ba-e388-40ec-9aca-3502c3649a01 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:40.164555 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3e70b9ba-e388-40ec-9aca-3502c3649a01 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:40.171979 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3e70b9ba-e388-40ec-9aca-3502c3649a01 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.172503 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3e70b9ba-e388-40ec-9aca-3502c3649a01 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.173282 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3e70b9ba-e388-40ec-9aca-3502c3649a01 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.173745 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3e70b9ba-e388-40ec-9aca-3502c3649a01 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.203922 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3e70b9ba-e388-40ec-9aca-3502c3649a01 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049972 Jul 04 09:19:40.204512 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 273/533] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:19:40 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:19:40.222685 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f1bf0adf-998d-4a22-9c29-0d5a73f07e34 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:40.223667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f1bf0adf-998d-4a22-9c29-0d5a73f07e34 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:40.225830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=17 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:40.226454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=78 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:40.231837 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1bf0adf-998d-4a22-9c29-0d5a73f07e34 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.232300 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1bf0adf-998d-4a22-9c29-0d5a73f07e34 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.233068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1bf0adf-998d-4a22-9c29-0d5a73f07e34 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.233507 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1bf0adf-998d-4a22-9c29-0d5a73f07e34 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.263265 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:40.263764 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:40.270455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.270897 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.271682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.272111 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.297750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:19:40.308574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f1bf0adf-998d-4a22-9c29-0d5a73f07e34 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/action" status: 202 len: 0 microversion: 2.1 time: 0.089803 Jul 04 09:19:40.312270 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 261/534] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:19:40 2022] POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:19:40.317547 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:40.318301 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:40.325123 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.325647 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.326392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.326821 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.396899 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5326af2f-38c9-44c2-837b-84e1ee134845 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 204 len: 0 microversion: 2.1 time: 0.137383 Jul 04 09:19:40.398324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 274/535] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:19:40 2022] DELETE /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:19:40.407071 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:40.407772 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:40.414116 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.414565 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.415338 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.415767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.544988 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.553689 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91487f5f-fed4-4301-93b3-d4b66d81e4d7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1751 microversion: 2.1 time: 0.240068 Jul 04 09:19:40.554330 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 262/536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:40 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:40.586762 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.594771 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b6995c6f-1e3c-4a3e-9573-498ac3427214 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1670 microversion: 2.1 time: 0.191882 Jul 04 09:19:40.595320 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 275/537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:40 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:41.574680 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:41.575469 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:41.584479 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.585068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.586112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.586723 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.612399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:41.612994 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:41.620478 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.620927 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.621719 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.622195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.805032 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:41.809974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:41.812751 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e105a55a-5303-45b3-a056-a322ec9b778d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1670 microversion: 2.1 time: 0.204344 Jul 04 09:19:41.813337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 276/538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:41 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1670 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:41.817996 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-909a545b-f755-4b83-9e54-0e37d462944e tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1751 microversion: 2.1 time: 0.249282 Jul 04 09:19:41.818577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 263/539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:41 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:42.831498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:42.832218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:42.835946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:42.836649 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:42.840817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.841417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.842279 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.842769 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.844719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.845163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.845913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.846385 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.061575 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:43.067941 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:43.069643 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7a4c992e-1132-479f-bd72-0daf8035e0cd tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1670 microversion: 2.1 time: 0.242289 Jul 04 09:19:43.070477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 277/540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:42 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:43.077766 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e85b7eae-f322-4868-8fb8-a122268dde08 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1751 microversion: 2.1 time: 0.246317 Jul 04 09:19:43.081922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 264/541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:42 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1751 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:43.300127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:43.300678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:43.307105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.307553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.308320 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.308748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.332162 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lazy-loading 'flavor' on Instance uuid 67f2244b-757a-430f-aeb4-c6c6a6d94214 {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:19:43.431266 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e235eb7e-c9cc-4878-9c4e-60d434e93fb9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "POST /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214/action" status: 202 len: 0 microversion: 2.1 time: 0.134806 Jul 04 09:19:43.435270 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 278/542] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:19:43 2022] POST /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:19:43.441464 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:43.442124 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:43.449451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.449921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.450715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.451393 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.591100 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:43.599300 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a32c16cc-1a15-4839-b6f0-5f7fee0440d3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.162764 Jul 04 09:19:43.599950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 265/543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:43 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:43.659390 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-212c682d-7a16-4c1a-ae91-4c049e5e396e req-19d2b2f3-e9a7-455b-859d-2b0660894389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b908667b-9eab-4249-b81a-acd8c6e40e86", "name": "network-vif-deleted", "tag": "232e0862-e534-47a3-801c-2e64bb8cb2cf"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:43.669099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-212c682d-7a16-4c1a-ae91-4c049e5e396e req-19d2b2f3-e9a7-455b-859d-2b0660894389 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.669099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-212c682d-7a16-4c1a-ae91-4c049e5e396e req-19d2b2f3-e9a7-455b-859d-2b0660894389 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.681227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-212c682d-7a16-4c1a-ae91-4c049e5e396e req-19d2b2f3-e9a7-455b-859d-2b0660894389 service nova] Creating event network-vif-deleted:232e0862-e534-47a3-801c-2e64bb8cb2cf for instance b908667b-9eab-4249-b81a-acd8c6e40e86 on hv-cinder-81914 Jul 04 09:19:43.686317 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-212c682d-7a16-4c1a-ae91-4c049e5e396e req-19d2b2f3-e9a7-455b-859d-2b0660894389 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031332 Jul 04 09:19:43.687531 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 279/544] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:44.089035 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:44.096218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:44.098342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:44.100308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:44.115232 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.115656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.116292 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.117545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.118562 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.119545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.119986 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.123366 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.218193 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.218723 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.219106 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lazy-loading 'fault' on Instance uuid b908667b-9eab-4249-b81a-acd8c6e40e86 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:19:44.288699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.298055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e5e41e66-21db-46ad-bd3d-003f9514d316 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 200 len: 1325 microversion: 2.1 time: 0.214539 Jul 04 09:19:44.299864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 266/545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:44 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:44.376574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.384917 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b2b4030d-f83c-4099-b719-731757da31be tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.293241 Jul 04 09:19:44.385775 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 280/546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:44 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:44.617521 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:44.618559 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:44.629717 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.630213 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.630991 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.631421 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.773442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.784876 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-12b8551a-0277-43d0-9bd1-c1669dec59bc tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.171759 Jul 04 09:19:44.794161 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 267/547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:44 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:44.878973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:44.879469 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:44.886072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.886516 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.887295 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.887723 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.973303 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lazy-loading 'services' on Instance uuid f404500c-0f77-4248-94bb-8d1eaf63a0bc {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:19:45.061944 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6ca63277-cf16-4531-9eb3-65b98b2f4c92 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments/31c9b1a1-a892-492d-b422-b47cad7da0d1" status: 202 len: 0 microversion: 2.1 time: 0.187034 Jul 04 09:19:45.062954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 281/548] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:19:44 2022] DELETE /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments/31c9b1a1-a892-492d-b422-b47cad7da0d1 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:19:45.071450 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-46ce25ed-b63f-4073-8ee4-5b26e18b3e67 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.072509 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-46ce25ed-b63f-4073-8ee4-5b26e18b3e67 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.082189 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46ce25ed-b63f-4073-8ee4-5b26e18b3e67 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.082686 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46ce25ed-b63f-4073-8ee4-5b26e18b3e67 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.083691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46ce25ed-b63f-4073-8ee4-5b26e18b3e67 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.084350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46ce25ed-b63f-4073-8ee4-5b26e18b3e67 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.119096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-46ce25ed-b63f-4073-8ee4-5b26e18b3e67 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051635 Jul 04 09:19:45.119827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 268/549] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:45.317595 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.318323 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.325215 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.326231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.327337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.327819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.342749 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] HTTP exception thrown: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Request method failure captured: Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 HTTP/1.1 Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-TbVC9IxUcogbz4WKLEhB6UjJJxaTEPQHY7QO-sYycLFebqvFobElVsMcLMnmk-F-QuorUCgIVQbgBuBzyacfZvdhlbIn7hJkV4ADa1DL0kf6iHM-YQ5xFamuo6kEguJ0HKtLVzXVHBjQouxNrQCy-a4nt7raDx84Fxhu_JmMSq4M Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:19:45.344796 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cfd9d65f66641b2bda6bbdcf908ca3c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}] Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 43bcd8fb25604011bfd1df823ea4ddad Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:19:45.346571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'b908667b-9eab-4249-b81a-acd8c6e40e86'} Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:45.351120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:19:45.352629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:45.354093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Returning 404 to user: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:45.354093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-560acc49-8760-4820-8525-a8168bcf6e87 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 404 len: 111 microversion: 2.1 time: 0.033099 Jul 04 09:19:45.354093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 282/550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:19:45.355800 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c2cfd6e4-0afb-42bb-aab6-0a2d91723792 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '.version_select at 0x7f8e81041820>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.376973 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c2cfd6e4-0afb-42bb-aab6-0a2d91723792 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96755608" status: 202 len: 0 microversion: 2.1 time: 0.025035 Jul 04 09:19:45.377527 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 269/551] 10.222.0.26 () {58 vars in 1214 bytes} [Mon Jul 4 09:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96755608 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:19:45.403044 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.404111 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.410791 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.411245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.412074 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.412509 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.803157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.803694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.809972 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.810416 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.811166 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.811592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.887139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:45.900755 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9149679e-6ec4-44ae-bdda-a3cb90d04342 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.501639 Jul 04 09:19:45.901935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 283/552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:46.080921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.089218 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4a629227-9f22-465f-83cf-358599e10533 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.290112 Jul 04 09:19:46.089803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 270/553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:46.133864 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4cd27c4e-654f-4b8f-9209-e2b35cdae5d7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:46.135023 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4cd27c4e-654f-4b8f-9209-e2b35cdae5d7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:46.141393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4cd27c4e-654f-4b8f-9209-e2b35cdae5d7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.141928 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4cd27c4e-654f-4b8f-9209-e2b35cdae5d7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.142892 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4cd27c4e-654f-4b8f-9209-e2b35cdae5d7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.143326 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4cd27c4e-654f-4b8f-9209-e2b35cdae5d7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.174931 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4cd27c4e-654f-4b8f-9209-e2b35cdae5d7 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047665 Jul 04 09:19:46.176151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 284/554] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:19:46 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 09:19:46.255280 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:46.255801 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:46.263653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.269340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.269340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.269340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.276384 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-11fc2b99-8566-42bb-8025-f9686be14a3e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'create', calling method: .version_select at 0x7f8e81054b80>, body: {"keypair": {"name": "tempest-keypair-1640035807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ8ByA4JrxWsPCaq4oAo+IlFj+qG0a2qpAm0ttvOc7DCxmsx6kZ8jBQt5Z1tWYIhwtLg3rkndDV4sOsZrgvfNSjCpnR1YRVfNCGOSlk3hRjC/sT6DMhxEQnNDgo3/n9wg=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:46.291569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-11fc2b99-8566-42bb-8025-f9686be14a3e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:46.293055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:19:46.295893 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-11fc2b99-8566-42bb-8025-f9686be14a3e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for user 43bcd8fb25604011bfd1df823ea4ddad and project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:46.321849 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-11fc2b99-8566-42bb-8025-f9686be14a3e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049556 Jul 04 09:19:46.322580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 285/555] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:19:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:19:46.377477 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3b0ffba3-aaa7-4b2c-901c-bae9bfa72acc tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 204 len: 0 microversion: 2.1 time: 0.125643 Jul 04 09:19:46.379133 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 271/556] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:19:46 2022] DELETE /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:19:46.389041 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:46.390035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:46.398561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.398882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.399893 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.400674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.573274 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.581324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9f2a59ac-b03c-4b60-be09-7dcff214f9a2 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1689 microversion: 2.1 time: 0.197517 Jul 04 09:19:46.581810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 286/557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:46 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:46.919422 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:46.920121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:46.927295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.927746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.928893 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.929331 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.106515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:47.107281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:47.114349 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.114811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.115601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.116032 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.135628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:47.208093 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:47.217244 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4bd5a573-b3fe-4c57-93eb-0a766b0c8bdd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.302020 Jul 04 09:19:47.217986 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 272/558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:46 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:47.573241 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:47.581221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-314c09f3-588b-4b13-b46d-e378f9f604e1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.478714 Jul 04 09:19:47.581784 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 287/559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:47 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:47.599563 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:47.600155 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:47.608465 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.609293 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.610206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.610625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.809025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:47.818027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8b98d2a0-5d8f-4769-836d-f37bc7ca45b9 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1689 microversion: 2.1 time: 0.222226 Jul 04 09:19:47.818631 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 273/560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:47 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:48.179712 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-333545771", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d34116fb-495d-48d9-8d0c-0773d154a526"}], "security_groups": [{"name": "tempest-securitygroup--2029977434"}], "key_name": "tempest-keypair-1640035807", "user_data": "}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:48.234628 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:48.235240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:48.241914 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.242409 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.243204 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.243633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.296508 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] validate_networks() for [('d34116fb-495d-48d9-8d0c-0773d154a526', None, None, None, None, None)] {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:19:48.492959 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.501384 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-88fbe094-2cf1-4d6c-ae36-463ac1032b21 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.270569 Jul 04 09:19:48.501983 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 274/561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:48 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:48.598694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:48.599297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:48.606613 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.607247 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.607795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.608220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.627355 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:48.812752 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:19:48.813280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:19:48.813673 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:19:48.814268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:19:48.814526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:19:48.817302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.824724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.825171 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.825321 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e2036d66-122d-4333-ad80-4f790ba18fea tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.230406 Jul 04 09:19:48.825913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 275/562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:48 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:48.826073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.826506 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.836674 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:48.837369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:48.843699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.844140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.844811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:48.844980 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.845321 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.848989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Getting quotas for user 43bcd8fb25604011bfd1df823ea4ddad and project 8cfd9d65f66641b2bda6bbdcf908ca3c. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:48.860614 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:19:48.863001 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:19:48.914725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b52e9bfe-1b00-42e1-8760-75a3dc55ad2d tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.739191 Jul 04 09:19:48.915961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 288/563] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:19:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:19:48.925491 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d0145312-4eb0-49c2-8929-1a0bc63377e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:48.926512 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d0145312-4eb0-49c2-8929-1a0bc63377e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:48.989514 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d0145312-4eb0-49c2-8929-1a0bc63377e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:49.000059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d0145312-4eb0-49c2-8929-1a0bc63377e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1237 microversion: 2.1 time: 0.078128 Jul 04 09:19:49.000917 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 289/564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:48 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:49.016974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:49.025218 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4759922c-b162-441b-8f0b-b605e07bb6cb tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1689 microversion: 2.1 time: 0.192349 Jul 04 09:19:49.025788 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 276/565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:48 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:49.522364 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:49.523421 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:49.530318 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.530762 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.531494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.531946 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.698251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:49.706747 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e39e7df7-005e-4937-951b-570ff298006c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.190767 Jul 04 09:19:49.707530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 290/566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:49 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:49.842701 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:49.843302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:49.849803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.850326 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.851243 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.851542 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.987975 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:49.998738 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-776f5e01-1a87-496c-93d6-b54ce2b83461 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.159705 Jul 04 09:19:49.999395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 277/567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:49 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:50.018433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:50.019034 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:50.025523 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.026002 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.026774 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.027209 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.043602 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:50.044495 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:50.050961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.051394 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.052169 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.052634 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.093777 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:50.102629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7d48d48a-51ac-45a6-8bab-63e0bffd6089 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1241 microversion: 2.1 time: 0.088430 Jul 04 09:19:50.103215 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 291/568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:50 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:50.201104 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:50.209314 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ae89bb1c-ffbd-45f1-91db-20c9489e5df0 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1689 microversion: 2.1 time: 0.169745 Jul 04 09:19:50.209951 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 278/569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:50 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:50.727358 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:50.728354 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:50.737029 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.738685 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.739801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.740486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.937307 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:50.946621 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d302980f-bf3c-462c-8c9b-804c1ddd5a4a tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.223286 Jul 04 09:19:50.947355 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 292/570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:50 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:51.017007 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:51.017583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:51.032591 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.032958 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.034072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.034774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.120091 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:51.121076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:51.146086 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.146902 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.148113 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.154586 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.357201 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.368218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-67fc5e4b-8e31-411a-8d7a-5acdfbe4cc89 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1295 microversion: 2.1 time: 0.250941 Jul 04 09:19:51.369554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 293/571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:51 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1295 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:51.374895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:51.375830 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:51.385156 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.386017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.387605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.388270 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.403634 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.416560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3a65d549-8cf7-408e-a7e3-e2c3f41ec8c0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.403710 Jul 04 09:19:51.417299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 279/572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:51 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:51.426625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-3c2d03aa-402a-47ec-b4e7-d79eb0501990 req-fd0d4440-a64d-449d-8927-67b55ce90a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f404500c-0f77-4248-94bb-8d1eaf63a0bc", "name": "network-vif-deleted", "tag": "0cb1b91f-f4e7-4260-86d4-761589933b09"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:51.450676 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3c2d03aa-402a-47ec-b4e7-d79eb0501990 req-fd0d4440-a64d-449d-8927-67b55ce90a5a service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.451233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3c2d03aa-402a-47ec-b4e7-d79eb0501990 req-fd0d4440-a64d-449d-8927-67b55ce90a5a service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.451732 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.452384 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.453056 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lazy-loading 'fault' on Instance uuid f404500c-0f77-4248-94bb-8d1eaf63a0bc {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:19:51.466518 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-3c2d03aa-402a-47ec-b4e7-d79eb0501990 req-fd0d4440-a64d-449d-8927-67b55ce90a5a service nova] Creating event network-vif-deleted:0cb1b91f-f4e7-4260-86d4-761589933b09 for instance f404500c-0f77-4248-94bb-8d1eaf63a0bc on hv-cinder-81914 Jul 04 09:19:51.472062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-3c2d03aa-402a-47ec-b4e7-d79eb0501990 req-fd0d4440-a64d-449d-8927-67b55ce90a5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053297 Jul 04 09:19:51.472813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 280/573] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:51.515309 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.523054 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-51f3e72d-c6d8-4440-8acc-f215dc818e82 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 200 len: 1335 microversion: 2.1 time: 0.152080 Jul 04 09:19:51.523750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 294/574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:51 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 1335 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:51.965550 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:51.966315 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:51.973223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.973667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.974467 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.974900 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.211938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:52.221261 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b755ad30-6a68-4282-b3ab-d0fad213a377 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.260494 Jul 04 09:19:52.231706 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 281/575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:51 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:52.387394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.388153 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:52.397104 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.398048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.399392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.400827 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.435142 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.436060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:52.450938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.452950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.456812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.458767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.698876 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:52.706592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-705423ba-0d95-45e7-98d3-1916842156fa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.324645 Jul 04 09:19:52.707190 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 295/576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:52 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:52.711838 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.712444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: f404500c-0f77-4248-94bb-8d1eaf63a0bc] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:52.716212 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:52.724020 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-902c3eae-1851-4650-ac61-5394c73ea6a9 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.292667 Jul 04 09:19:52.724756 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 282/577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:52 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:52.733962 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.734489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.735328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.735762 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.750734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] HTTP exception thrown: Instance f404500c-0f77-4248-94bb-8d1eaf63a0bc could not be found. Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Request method failure captured: Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc HTTP/1.1 Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-OmtcNhVqntRlyIJLc3i65jC9RnMZJxWJq6ip8ODRno-ES3hTRMNX1nVDJhcIj2eLLKlqBYLLGPpwZFZa0dvMfRnfnNpiSvpsx2tdP6Qp76HuIKnsEPgum2S9fpT5PoOZ830fcCeV8ULI8q_N0FJ-gJrrtFKqql9PSwROWs13s4vM Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:19:52.752231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_48690ebc49824572a08f53597eeee661", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/48690ebc49824572a08f53597eeee661"}]}] Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 1e916bf18efe421895c8d7b28fcd55d5 Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance f404500c-0f77-4248-94bb-8d1eaf63a0bc could not be found. Jul 04 09:19:52.753817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'f404500c-0f77-4248-94bb-8d1eaf63a0bc'} Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f404500c-0f77-4248-94bb-8d1eaf63a0bc could not be found. Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:52.754731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f404500c-0f77-4248-94bb-8d1eaf63a0bc could not be found. Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f404500c-0f77-4248-94bb-8d1eaf63a0bc could not be found. Jul 04 09:19:52.756132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:52.758337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Returning 404 to user: Instance f404500c-0f77-4248-94bb-8d1eaf63a0bc could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:52.759412 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4fe2b6af-0b66-41ae-9588-17d3f0745e3c tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc" status: 404 len: 111 microversion: 2.1 time: 0.051317 Jul 04 09:19:52.760530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 296/578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:52 2022] GET /compute/v2.1/servers/f404500c-0f77-4248-94bb-8d1eaf63a0bc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:19:52.770315 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cbba68ec-c0ce-4561-87a1-5b74408f3a98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '.version_select at 0x7f8e810a6ca0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.776743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-cd233013-ba29-43a1-97e2-39de2b3cc5c0 req-add03ff9-abfb-47f3-ad72-197f68de530f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44fe99f-2d33-48fc-8093-0b98e37ce8e2", "tag": "8cde69f6-6a15-4f69-a13f-6914787dd859"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:52.800031 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cbba68ec-c0ce-4561-87a1-5b74408f3a98 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283158391" status: 202 len: 0 microversion: 2.1 time: 0.034458 Jul 04 09:19:52.801190 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 283/579] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 4 09:19:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283158391 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:19:52.808385 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-cd233013-ba29-43a1-97e2-39de2b3cc5c0 req-add03ff9-abfb-47f3-ad72-197f68de530f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.811555 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-cd233013-ba29-43a1-97e2-39de2b3cc5c0 req-add03ff9-abfb-47f3-ad72-197f68de530f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.839258 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-cd233013-ba29-43a1-97e2-39de2b3cc5c0 req-add03ff9-abfb-47f3-ad72-197f68de530f service nova] Creating event network-changed:8cde69f6-6a15-4f69-a13f-6914787dd859 for instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 on hv-cinder-81914 Jul 04 09:19:52.849220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-cd233013-ba29-43a1-97e2-39de2b3cc5c0 req-add03ff9-abfb-47f3-ad72-197f68de530f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078619 Jul 04 09:19:52.849875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 297/580] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:53.239254 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:53.240456 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:53.247753 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.248767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.249970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.250578 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.410159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:53.418711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-77ac6fd0-8766-42f3-ad6b-1b8801490031 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.183780 Jul 04 09:19:53.419509 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 284/581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:53 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:53.728636 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:53.729582 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:53.736901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.737345 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.738268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.738837 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.740784 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:53.741642 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:53.749098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.749683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.750774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.751269 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.941238 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:53.944906 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:53.949184 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-cfb16b8b-ecd1-409b-8b6e-f0e8f44da12e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.227918 Jul 04 09:19:53.949838 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 298/582] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:53 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:53.952596 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-863afada-25a1-48c3-8a6e-35f0da75697c tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.215840 Jul 04 09:19:53.953242 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 285/583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:53 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:54.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:54.438396 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:54.446098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.446549 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.447368 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.447804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.671242 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:54.680070 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-91d5ea0b-557f-4757-87df-a51a0ffc6687 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.247601 Jul 04 09:19:54.680815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 299/584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:54 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:54.967072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:54.967766 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:54.969729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:54.970477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:54.974857 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.975287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.976896 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.977340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.978040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.978535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.979388 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.979883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.463547 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.467737 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.471451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a31ba1dc-f2c5-4f97-8fa3-5fe0689214aa tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.508716 Jul 04 09:19:55.472014 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 286/585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:54 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:55.477181 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-998b9ada-69f3-47e4-9170-d614b082c096 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.511260 Jul 04 09:19:55.478002 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 300/586] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:54 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:55.701458 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:55.702607 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:55.712064 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.712502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.713260 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.713691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.863256 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.875149 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9174c9c5-c9b5-4a28-bfec-7c7b7b1321d1 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1756 microversion: 2.1 time: 0.180610 Jul 04 09:19:55.875729 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 287/587] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:55 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:55.953008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:55.953462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:55.961853 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.962440 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.963277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.963709 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.991719 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:19:56.074104 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:56.083645 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3202b379-feb4-443b-8262-0b1cd0ef5e7a tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 204 len: 0 microversion: 2.1 time: 0.134456 Jul 04 09:19:56.084427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 301/588] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:19:55 2022] DELETE /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:19:56.092722 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:56.093340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:56.100380 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.100869 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.101651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.102157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.237162 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:56.245850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a0f13503-2d1a-483a-850e-f356c6128387 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1506 microversion: 2.1 time: 0.157134 Jul 04 09:19:56.246467 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 288/589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:56 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:56.493297 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:56.494069 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:56.498218 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:56.498808 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:56.500986 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.501434 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.502251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.502688 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.505032 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.505482 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.506261 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.506690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.697479 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:56.700839 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:56.705497 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f1e3df13-9234-4638-9471-eb35c1d9020f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.211179 Jul 04 09:19:56.706207 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 289/590] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:56 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:56.709441 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-79de33da-9491-4521-997f-0d8b424b9ff3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.220439 Jul 04 09:19:56.710336 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 302/591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:56 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:56.894342 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:56.894953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:56.901534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.902001 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.902767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.903190 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.046812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:57.054815 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a298f1ff-42be-4d0c-83d5-edd94ef9eebd tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1759 microversion: 2.1 time: 0.164343 Jul 04 09:19:57.055376 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 290/592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:56 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:57.263427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:57.263994 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:57.271213 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.271671 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.272472 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.272986 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.409734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:57.417571 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-81b817e7-8e80-4302-a699-7f2dc8b2fba6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1506 microversion: 2.1 time: 0.158098 Jul 04 09:19:57.418196 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 303/593] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:57 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:57.731817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:57.733028 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:57.734327 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:57.734933 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:57.741397 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.742105 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.742738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.742883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.743177 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.743343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.744021 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.744448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.941684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:57.945178 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:57.950411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-feeaa5b8-ff59-484f-b45f-0bda60d2015a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.219758 Jul 04 09:19:57.951152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 304/594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:57 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:57.953062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c14eb013-27a3-46df-add1-b18e921705d5 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.225538 Jul 04 09:19:57.953624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 291/595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:57 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:58.435443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:58.435998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:58.443446 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.444195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.445341 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.445921 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.451563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:58.676151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:58.684111 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-788f84aa-0964-406c-8059-858d312eda3e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 200 len: 1506 microversion: 2.1 time: 0.253269 Jul 04 09:19:58.684935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 305/596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:58 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:58.925061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-80001c17-ec5f-4f69-b2d7-e0888b354495 req-66b46b08-e8ad-4cfd-b272-8b72dddfffde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf474beb-fb86-4571-a949-b4fde11c34db", "name": "network-vif-deleted", "tag": "90432259-5748-4275-9dd4-31b28ac81966"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:58.934055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-80001c17-ec5f-4f69-b2d7-e0888b354495 req-66b46b08-e8ad-4cfd-b272-8b72dddfffde service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.934508 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-80001c17-ec5f-4f69-b2d7-e0888b354495 req-66b46b08-e8ad-4cfd-b272-8b72dddfffde service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.947286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-80001c17-ec5f-4f69-b2d7-e0888b354495 req-66b46b08-e8ad-4cfd-b272-8b72dddfffde service nova] Creating event network-vif-deleted:90432259-5748-4275-9dd4-31b28ac81966 for instance bf474beb-fb86-4571-a949-b4fde11c34db on hv-cinder-81914 Jul 04 09:19:58.952670 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-80001c17-ec5f-4f69-b2d7-e0888b354495 req-66b46b08-e8ad-4cfd-b272-8b72dddfffde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032295 Jul 04 09:19:58.953569 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 292/597] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:58.970917 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:58.971558 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:58.972860 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:58.973651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:58.979544 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:58.982356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.982356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.983089 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.985187 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.985721 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.986600 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.987091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.990180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.997729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=12 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:59.197939 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:59.206327 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:59.208093 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7c00ae6a-0f51-4ac7-a635-f7cacc5cd0a6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.239548 Jul 04 09:19:59.209297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 293/598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:58 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:59.214157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dd0df49b-af3c-48fc-b8c4-79dfecd815a3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.248553 Jul 04 09:19:59.214729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 306/599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:58 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:59.215151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-74e62969-fced-4b32-9b8a-c726b0fa9822 req-f75ad723-4522-45d3-9f69-1500b8f99bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44fe99f-2d33-48fc-8093-0b98e37ce8e2", "name": "network-vif-plugged", "status": "completed", "tag": "8cde69f6-6a15-4f69-a13f-6914787dd859"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:59.224293 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-74e62969-fced-4b32-9b8a-c726b0fa9822 req-f75ad723-4522-45d3-9f69-1500b8f99bad service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.225035 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-74e62969-fced-4b32-9b8a-c726b0fa9822 req-f75ad723-4522-45d3-9f69-1500b8f99bad service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.237555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-74e62969-fced-4b32-9b8a-c726b0fa9822 req-f75ad723-4522-45d3-9f69-1500b8f99bad service nova] Creating event network-vif-plugged:8cde69f6-6a15-4f69-a13f-6914787dd859 for instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 on hv-cinder-81914 Jul 04 09:19:59.242700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-74e62969-fced-4b32-9b8a-c726b0fa9822 req-f75ad723-4522-45d3-9f69-1500b8f99bad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jul 04 09:19:59.243303 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 294/600] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:59.700700 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:59.701414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: bf474beb-fb86-4571-a949-b4fde11c34db] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:59.708058 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.708512 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.709284 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.709921 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.727084 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] HTTP exception thrown: Instance bf474beb-fb86-4571-a949-b4fde11c34db could not be found. Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Request method failure captured: Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db HTTP/1.1 Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-OmtcNhVqntRlyIJLc3i65jC9RnMZJxWJq6ip8ODRno-ES3hTRMNX1nVDJhcIj2eLLKlqBYLLGPpwZFZa0dvMfRnfnNpiSvpsx2tdP6Qp76HuIKnsEPgum2S9fpT5PoOZ830fcCeV8ULI8q_N0FJ-gJrrtFKqql9PSwROWs13s4vM Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:19:59.730227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_48690ebc49824572a08f53597eeee661", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/48690ebc49824572a08f53597eeee661"}]}] Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 1e916bf18efe421895c8d7b28fcd55d5 Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance bf474beb-fb86-4571-a949-b4fde11c34db could not be found. Jul 04 09:19:59.731699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'bf474beb-fb86-4571-a949-b4fde11c34db'} Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf474beb-fb86-4571-a949-b4fde11c34db could not be found. Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:59.732560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf474beb-fb86-4571-a949-b4fde11c34db could not be found. Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf474beb-fb86-4571-a949-b4fde11c34db could not be found. Jul 04 09:19:59.734035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:19:59.735314 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Returning 404 to user: Instance bf474beb-fb86-4571-a949-b4fde11c34db could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:59.735314 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d39b59fd-0a3a-42f0-b975-74d0340521a6 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db" status: 404 len: 111 microversion: 2.1 time: 0.035488 Jul 04 09:19:59.735314 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 307/601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:59 2022] GET /compute/v2.1/servers/bf474beb-fb86-4571-a949-b4fde11c34db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:19:59.743702 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:59.744365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:59.753274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.753733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.754539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.755210 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.763151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:59.782180 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:19:59.862172 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-afb4a2a1-bd54-48c0-a2a4-d9457d9e451e tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 204 len: 0 microversion: 2.1 time: 0.123361 Jul 04 09:19:59.862749 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 295/602] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:19:59 2022] DELETE /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:19:59.871384 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:59.872008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:59.878272 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.878729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.879492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.879927 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:00.052718 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:00.060896 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0002fa0a-3960-420b-965a-d68320b3d514 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.193340 Jul 04 09:20:00.061501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 308/603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:59 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:00.235207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:00.235739 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:00.242201 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:00.242730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:00.243615 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:00.244047 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:00.286744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:00.287455 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:00.293845 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:00.294322 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:00.295089 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:00.295521 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:00.435173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:00.442886 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-778571fd-0cb9-475c-9e87-e6c5e14a356a tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.211590 Jul 04 09:20:00.443497 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 309/604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:00 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:00.458893 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:00.468917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f01466ef-2e96-42c0-8420-10edeed2aa4f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.246833 Jul 04 09:20:00.469749 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 296/605] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:00 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:01.083358 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:01.084181 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:01.093910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.094377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:01.095149 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.095577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:01.240410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:01.251660 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-be70a30f-9ece-4282-81b7-def9ff2166e8 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.174010 Jul 04 09:20:01.252494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 310/606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:01 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:01.461199 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:01.461755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:01.469054 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.469508 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:01.470293 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.470751 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:01.489752 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:01.490406 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:01.498724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.499484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:01.500867 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.501703 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:01.699639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:01.706873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:01.707634 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-86667740-f27a-4b8b-89b2-bae60e402182 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.251062 Jul 04 09:20:01.708220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 297/607] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:01 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:01.715204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3052125b-031a-4cd5-a8f1-b65be29ca502 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.230168 Jul 04 09:20:01.715857 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 311/608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:01 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:02.269226 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:02.269824 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:02.276376 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:02.276815 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.277571 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:02.278041 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.416338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:02.426604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b5071349-69ac-4ef0-87ef-a5ac665dcd09 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.161439 Jul 04 09:20:02.427167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 298/609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:02 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:02.725404 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:02.726234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:02.732262 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:02.733049 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:02.733173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:02.733539 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.734352 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:02.735001 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.739825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:02.740246 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.741002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:02.741467 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.948744 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:02.951989 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:02.956880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-509deb1c-9bb8-426e-bbdb-deaef90c8955 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.235533 Jul 04 09:20:02.957462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 312/610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:02 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:02.959569 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-39f1a565-8e95-4d37-8b46-5c06bb4fa477 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1363 microversion: 2.1 time: 0.231055 Jul 04 09:20:02.960195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 299/611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:02 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:03.444592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:03.445227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:03.451632 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:03.452083 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:03.453210 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:03.453343 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:03.596462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:03.604354 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e6899c51-f89e-408f-99c4-b23a34f26779 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1520 microversion: 2.1 time: 0.163686 Jul 04 09:20:03.604977 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 313/612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:03 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:03.944302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-7d0b59cd-066f-4cc5-a35a-e3a41218926a req-6df6d086-69ef-498e-9aa4-25e2ad524ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb12a448-abd1-4f71-a368-8e85bedaf38b", "name": "network-vif-deleted", "tag": "4d51a8b6-0abd-4c35-b502-9d5ad3cc0c9d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:03.953608 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7d0b59cd-066f-4cc5-a35a-e3a41218926a req-6df6d086-69ef-498e-9aa4-25e2ad524ee3 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:03.954032 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7d0b59cd-066f-4cc5-a35a-e3a41218926a req-6df6d086-69ef-498e-9aa4-25e2ad524ee3 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:03.964760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-7d0b59cd-066f-4cc5-a35a-e3a41218926a req-6df6d086-69ef-498e-9aa4-25e2ad524ee3 service nova] Creating event network-vif-deleted:4d51a8b6-0abd-4c35-b502-9d5ad3cc0c9d for instance eb12a448-abd1-4f71-a368-8e85bedaf38b on hv-cinder-81914 Jul 04 09:20:03.969753 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-7d0b59cd-066f-4cc5-a35a-e3a41218926a req-6df6d086-69ef-498e-9aa4-25e2ad524ee3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029175 Jul 04 09:20:03.970561 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 300/613] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:03.974937 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:03.975668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:03.977856 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:03.978583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:03.981616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:03.983280 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:03.983754 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:03.984746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:03.985152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:03.985381 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:03.985836 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:03.986672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:03.987103 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:04.190685 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:04.193613 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:04.198609 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8ae50bf0-9ea6-44d3-8b8d-74ea0317f9d7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.227863 Jul 04 09:20:04.199410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 314/614] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:03 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:04.202345 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b75adecf-b08a-4d1e-bd6b-b1aa43b7a4e7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1548 microversion: 2.1 time: 0.228845 Jul 04 09:20:04.203027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 301/615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:03 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:04.218698 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-260285bc-8773-4583-9909-a9196094f15f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:04.219190 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-260285bc-8773-4583-9909-a9196094f15f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:04.225726 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260285bc-8773-4583-9909-a9196094f15f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:04.226209 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260285bc-8773-4583-9909-a9196094f15f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:04.226985 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260285bc-8773-4583-9909-a9196094f15f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:04.227420 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-260285bc-8773-4583-9909-a9196094f15f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:04.310648 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-260285bc-8773-4583-9909-a9196094f15f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095538 Jul 04 09:20:04.311347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 315/616] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:20:04 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:04.621234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:04.621836 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:04.629004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:04.629698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:04.630527 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:04.630946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:04.695841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:04.703571 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-040ef8dd-a849-4dd5-8e3a-a649dcafda76 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1478 microversion: 2.1 time: 0.086582 Jul 04 09:20:04.704341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 302/617] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:04 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1478 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:05.216730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:05.217310 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:05.223704 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:05.224157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:05.224920 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:05.225347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:05.372513 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:05.380970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e8b56a05-c82b-44b0-bd81-7cbc3bb7e245 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.168788 Jul 04 09:20:05.382007 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 316/618] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:05 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:05.722252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:05.723063 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:05.741093 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:05.741726 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:05.742557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:05.742994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:05.779780 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:05.780230 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:05.780863 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lazy-loading 'fault' on Instance uuid eb12a448-abd1-4f71-a368-8e85bedaf38b {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:20:05.843719 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e916bf18efe421895c8d7b28fcd55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48690ebc49824572a08f53597eeee661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:05.851189 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aae2f4a8-70c0-4af0-b1eb-3a942799d0fe tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 200 len: 1311 microversion: 2.1 time: 0.134417 Jul 04 09:20:05.852140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 303/619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:05 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:05.984729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-1d532611-c6d8-4313-b99b-d6d5d7eb3848 req-2328b2b7-ae28-4e77-a7c7-ce4cc10ce002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44fe99f-2d33-48fc-8093-0b98e37ce8e2", "tag": "8cde69f6-6a15-4f69-a13f-6914787dd859"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:05.993844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1d532611-c6d8-4313-b99b-d6d5d7eb3848 req-2328b2b7-ae28-4e77-a7c7-ce4cc10ce002 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:05.994395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1d532611-c6d8-4313-b99b-d6d5d7eb3848 req-2328b2b7-ae28-4e77-a7c7-ce4cc10ce002 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.006021 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-1d532611-c6d8-4313-b99b-d6d5d7eb3848 req-2328b2b7-ae28-4e77-a7c7-ce4cc10ce002 service nova] Creating event network-changed:8cde69f6-6a15-4f69-a13f-6914787dd859 for instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 on hv-cinder-81914 Jul 04 09:20:06.011343 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-1d532611-c6d8-4313-b99b-d6d5d7eb3848 req-2328b2b7-ae28-4e77-a7c7-ce4cc10ce002 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030315 Jul 04 09:20:06.012409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 317/620] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:06.399446 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:06.400086 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:06.406662 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.407140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.407968 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.408424 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.549322 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:06.559439 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ffb0170a-c5d8-4076-b524-a539cef70409 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1509 microversion: 2.1 time: 0.163689 Jul 04 09:20:06.562566 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 304/621] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:06 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:06.577756 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-eda1aba0-d7f3-42ad-9b1b-fd5bdd51bc86 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:06.578476 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-eda1aba0-d7f3-42ad-9b1b-fd5bdd51bc86 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:06.584869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eda1aba0-d7f3-42ad-9b1b-fd5bdd51bc86 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.585414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eda1aba0-d7f3-42ad-9b1b-fd5bdd51bc86 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.586440 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eda1aba0-d7f3-42ad-9b1b-fd5bdd51bc86 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.587036 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-eda1aba0-d7f3-42ad-9b1b-fd5bdd51bc86 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.737862 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-eda1aba0-d7f3-42ad-9b1b-fd5bdd51bc86 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "POST /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214/action" status: 202 len: 0 microversion: 2.1 time: 0.164886 Jul 04 09:20:06.739478 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 318/622] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:20:06 2022] POST /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:20:06.748286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:06.748859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:06.755917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.756426 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.758012 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.758467 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.869727 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:06.870674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] [instance: eb12a448-abd1-4f71-a368-8e85bedaf38b] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:06.877013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.877319 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.878132 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:06.878605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:06.893770 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] HTTP exception thrown: Instance eb12a448-abd1-4f71-a368-8e85bedaf38b could not be found. Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Request method failure captured: Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b HTTP/1.1 Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-OmtcNhVqntRlyIJLc3i65jC9RnMZJxWJq6ip8ODRno-ES3hTRMNX1nVDJhcIj2eLLKlqBYLLGPpwZFZa0dvMfRnfnNpiSvpsx2tdP6Qp76HuIKnsEPgum2S9fpT5PoOZ830fcCeV8ULI8q_N0FJ-gJrrtFKqql9PSwROWs13s4vM Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:20:06.895498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_48690ebc49824572a08f53597eeee661", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/48690ebc49824572a08f53597eeee661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/48690ebc49824572a08f53597eeee661"}]}] Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 48690ebc49824572a08f53597eeee661 Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1032945525 Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 1e916bf18efe421895c8d7b28fcd55d5 Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1032945525-project Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance eb12a448-abd1-4f71-a368-8e85bedaf38b could not be found. Jul 04 09:20:06.896767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'eb12a448-abd1-4f71-a368-8e85bedaf38b'} Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb12a448-abd1-4f71-a368-8e85bedaf38b could not be found. Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:06.897520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb12a448-abd1-4f71-a368-8e85bedaf38b could not be found. Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb12a448-abd1-4f71-a368-8e85bedaf38b could not be found. Jul 04 09:20:06.898810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:06.900048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] Returning 404 to user: Instance eb12a448-abd1-4f71-a368-8e85bedaf38b could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:06.900048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-36c4cec1-f7de-44fd-a27f-18fb6880da01 tempest-ServerRescueNegativeTestJSON-1032945525 tempest-ServerRescueNegativeTestJSON-1032945525-project] 10.222.0.26 "GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b" status: 404 len: 111 microversion: 2.1 time: 0.032382 Jul 04 09:20:06.900048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 319/623] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:06 2022] GET /compute/v2.1/servers/eb12a448-abd1-4f71-a368-8e85bedaf38b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:06.921779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:06.930175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-715ad35c-7234-49de-b45e-1f47a63de2b3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1517 microversion: 2.1 time: 0.186412 Jul 04 09:20:06.930825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 305/624] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:06 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:07.100835 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-07cde0c7-62ba-438d-9c71-db62231e700a req-b265bcc2-eb11-42c5-8b31-adb03e85b205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f2244b-757a-430f-aeb4-c6c6a6d94214", "name": "network-vif-unplugged", "status": "completed", "tag": "78c383e3-0712-437b-8c6a-9bd8b90e67f0"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:07.111324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-07cde0c7-62ba-438d-9c71-db62231e700a req-b265bcc2-eb11-42c5-8b31-adb03e85b205 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:07.112087 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-07cde0c7-62ba-438d-9c71-db62231e700a req-b265bcc2-eb11-42c5-8b31-adb03e85b205 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:07.125008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.compute.server_external_events [req-07cde0c7-62ba-438d-9c71-db62231e700a req-b265bcc2-eb11-42c5-8b31-adb03e85b205 service nova] Unable to find a host for instance 67f2244b-757a-430f-aeb4-c6c6a6d94214. Dropping event network-vif-unplugged {{(pid=117795) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 09:20:07.126913 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-07cde0c7-62ba-438d-9c71-db62231e700a req-b265bcc2-eb11-42c5-8b31-adb03e85b205 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030161 Jul 04 09:20:07.127707 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 320/625] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 04 09:20:07.947960 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:07.948576 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:07.955593 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:07.956047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:07.956821 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:07.957256 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:08.107881 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:08.117934 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-39d62c55-8d23-4fcd-8832-2f50bb768db1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1519 microversion: 2.1 time: 0.173645 Jul 04 09:20:08.118651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 306/626] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:07 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:09.136390 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:09.137452 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:09.150749 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:09.151161 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:09.152166 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:09.152607 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:09.298052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:09.305787 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5e5a23a1-a73a-44b8-8a71-6f523c17a592 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.173391 Jul 04 09:20:09.306403 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 321/627] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:09 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:10.323037 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:10.323651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:10.330475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:10.330950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:10.331927 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:10.332138 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:10.563294 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:10.572958 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3b4dccc9-e13e-4ea4-a0d0-1e38adec59a7 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.253859 Jul 04 09:20:10.574342 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 307/628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:10 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:11.590880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:11.591579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:11.598644 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:11.599159 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:11.600031 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:11.600661 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:11.742953 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:11.751175 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-516eb4e3-493b-4ec0-8447-693ce1740ed3 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.164216 Jul 04 09:20:11.751788 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 322/629] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:11 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:12.771990 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:12.773336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:12.779950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:12.780402 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:12.781152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:12.781579 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:12.921052 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:12.928694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c5823b12-e64a-47b7-8443-905ad12ebc73 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.162591 Jul 04 09:20:12.929381 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 308/630] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:12 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:13.946856 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:13.947747 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:13.954760 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:13.955293 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:13.956138 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:13.956573 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:14.095049 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:14.098662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:14.104797 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fac150fe-d5ef-4c56-8703-8268712646c1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.162583 Jul 04 09:20:14.105383 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 323/631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:13 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:15.122177 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:15.122782 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:15.130724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:15.134241 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:15.135169 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:15.135802 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:15.321285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:15.333295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-70c95775-c588-4e76-a192-e33b17ee2b0e tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.214885 Jul 04 09:20:15.343961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 309/632] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:15 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:16.352942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:16.353797 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:16.361698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:16.362393 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:16.363552 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:16.364085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:16.392160 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a6e038b8-3838-44e4-82d9-070af6d882e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'create', calling method: .version_select at 0x7f8e80f57790>, body: {"keypair": {"name": "tempest-keypair-2016757017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg35N7/VIFCVE+f5eBYUeOAeJGWZ0YiqMhwLgbz5sgDAwx5GMotIOZcXjILMBQeNh8Y3RdOkqT8YX2sfvigSTsphdVSMYKsIq6BD0TECIvGU5PrJF6wIb81f2MA2N5uSg=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:16.399619 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:16.411695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-a6e038b8-3838-44e4-82d9-070af6d882e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for project 4677b4c393ff41a09c922467365e06f0. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:16.416034 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-a6e038b8-3838-44e4-82d9-070af6d882e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for user bcad5b2163e647f386b482731e1de798 and project 4677b4c393ff41a09c922467365e06f0. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:16.445975 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a6e038b8-3838-44e4-82d9-070af6d882e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.182380 Jul 04 09:20:16.446799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 324/633] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 4 09:20:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 09:20:16.534394 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:16.547171 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-42766aed-5078-4e19-91e7-82b390620941 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.198657 Jul 04 09:20:16.557645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 310/634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:16 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:17.564431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:17.565663 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:17.572511 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:17.572761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:17.573710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:17.575853 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:17.719853 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:17.729441 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7ad33eed-9596-4e39-b2ac-24f2f4a57419 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.169333 Jul 04 09:20:17.730252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 325/635] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:17 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:17.846578 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1980504806", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "460f8279-d422-4942-bdf8-e5307675ed2c"}], "security_groups": [{"name": "tempest-securitygroup--384658875"}], "key_name": "tempest-keypair-2016757017", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:17.954046 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] validate_networks() for [('460f8279-d422-4942-bdf8-e5307675ed2c', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:20:18.405183 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:20:18.405605 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:20:18.406208 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:20:18.406614 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:20:18.407048 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:20:18.416675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:18.417119 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:18.417917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:18.418387 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:18.435548 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for project 4677b4c393ff41a09c922467365e06f0. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:18.439736 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for user bcad5b2163e647f386b482731e1de798 and project 4677b4c393ff41a09c922467365e06f0. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:18.450945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:20:18.453236 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:20:18.503999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2a75c92b-c20d-4a68-878e-47eecc20901e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.661845 Jul 04 09:20:18.509773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 311/636] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 4 09:20:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 04 09:20:18.514919 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-85845651-f21a-4f9d-a723-a9457e97b93e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:18.516018 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-85845651-f21a-4f9d-a723-a9457e97b93e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:18.573226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-85845651-f21a-4f9d-a723-a9457e97b93e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:18.580400 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-85845651-f21a-4f9d-a723-a9457e97b93e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:18.582407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-85845651-f21a-4f9d-a723-a9457e97b93e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:18.584170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-85845651-f21a-4f9d-a723-a9457e97b93e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1282 microversion: 2.20 time: 0.073248 Jul 04 09:20:18.585610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 326/637] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:18 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:18.748043 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:18.748757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:18.756220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:18.757007 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:18.758045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:18.758745 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:18.950476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:18.961305 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8059cebd-aa08-4f05-98f0-151a56bcffb0 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.217192 Jul 04 09:20:18.972067 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 312/638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:18 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:19.179209 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-4765890a-3384-4807-88fa-40fd9b1cb30a req-3f8ef28f-b66e-44f3-aad0-6c760f1a07d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f2244b-757a-430f-aeb4-c6c6a6d94214", "name": "network-vif-plugged", "status": "completed", "tag": "78c383e3-0712-437b-8c6a-9bd8b90e67f0"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:19.193037 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-4765890a-3384-4807-88fa-40fd9b1cb30a req-3f8ef28f-b66e-44f3-aad0-6c760f1a07d6 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:19.193825 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-4765890a-3384-4807-88fa-40fd9b1cb30a req-3f8ef28f-b66e-44f3-aad0-6c760f1a07d6 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:19.206430 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-4765890a-3384-4807-88fa-40fd9b1cb30a req-3f8ef28f-b66e-44f3-aad0-6c760f1a07d6 service nova] Creating event network-vif-plugged:78c383e3-0712-437b-8c6a-9bd8b90e67f0 for instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 on hv-cinder-81914 Jul 04 09:20:19.212631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-4765890a-3384-4807-88fa-40fd9b1cb30a req-3f8ef28f-b66e-44f3-aad0-6c760f1a07d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037552 Jul 04 09:20:19.213447 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 327/639] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:19.604265 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:19.604995 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:19.612856 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:19.613411 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:19.614566 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:19.615068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:19.708948 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:19.719550 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:19.721569 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:19.722898 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-895582b1-52f1-4c20-bb8d-8864739030a9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1334 microversion: 2.20 time: 0.123852 Jul 04 09:20:19.723640 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 313/640] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:19 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:19.980136 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:19.980838 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:19.988047 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:19.988486 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:19.989247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:19.989669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:20.407471 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:20.416005 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-669d4ba5-b7fc-45bc-987a-a12f2a4c567f tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1575 microversion: 2.1 time: 0.441008 Jul 04 09:20:20.416603 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 328/641] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:19 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1575 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:20.742970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:20.744425 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:20.751669 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:20.752472 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:20.753448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:20.754152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:20.829820 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:20.839108 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:20.840817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:20.841976 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3d7ea50b-7d2c-43ce-82c7-250fdcebcde0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1340 microversion: 2.20 time: 0.103765 Jul 04 09:20:20.842670 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 314/642] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:20 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:21.437489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:21.439459 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:21.449392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.450060 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:21.450918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.451721 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:21.709490 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:21.717465 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b1c9598b-8e58-4fd5-b2bb-4267bd485f92 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1562 microversion: 2.1 time: 0.284194 Jul 04 09:20:21.718072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 329/643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:21 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1562 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:21.860028 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:21.860591 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:21.868036 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.868482 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:21.869240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.869666 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:22.084711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:22.092915 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:22.094532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:22.095714 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-44f5989a-45c3-477d-994f-f715022f195d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1407 microversion: 2.20 time: 0.239712 Jul 04 09:20:22.096374 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 315/644] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:21 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:22.284454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-f0974860-1213-4a5a-8816-eaaa7bac3be9 req-533c9c9d-60ed-4b01-9fba-11100ef68aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6adb6fa-7a9a-4413-b937-aecda176cccd", "tag": "17a3b35a-43ba-4047-9cb2-8075dbd8e1e7"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:22.293810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-f0974860-1213-4a5a-8816-eaaa7bac3be9 req-533c9c9d-60ed-4b01-9fba-11100ef68aa7 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:22.294281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-f0974860-1213-4a5a-8816-eaaa7bac3be9 req-533c9c9d-60ed-4b01-9fba-11100ef68aa7 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:22.306547 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-f0974860-1213-4a5a-8816-eaaa7bac3be9 req-533c9c9d-60ed-4b01-9fba-11100ef68aa7 service nova] Creating event network-changed:17a3b35a-43ba-4047-9cb2-8075dbd8e1e7 for instance b6adb6fa-7a9a-4413-b937-aecda176cccd on hv-cinder-81914 Jul 04 09:20:22.311346 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-f0974860-1213-4a5a-8816-eaaa7bac3be9 req-533c9c9d-60ed-4b01-9fba-11100ef68aa7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104017 Jul 04 09:20:22.312462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 330/645] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:23.118201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:23.118839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:23.125574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:23.126056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:23.126818 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:23.127253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:23.263523 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:23.271757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:23.273290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:23.274558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7d048aa7-19fb-489d-926d-9d0bd47e73e8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1407 microversion: 2.20 time: 0.162463 Jul 04 09:20:23.275298 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 316/646] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:23 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:24.294944 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:24.295695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:24.303291 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:24.303817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:24.304804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:24.305328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:24.457259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:24.469561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:24.472000 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:24.473399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-67c3cf46-6a61-497c-9956-1323da064ac6 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1407 microversion: 2.20 time: 0.183756 Jul 04 09:20:24.474321 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 331/647] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:24 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:25.493100 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:25.493690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:25.500324 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:25.500767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:25.501534 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:25.501983 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:25.634938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:25.643529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:25.645031 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:25.646222 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be4b6cb2-9a5a-49c3-aa62-81d3837c2944 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1407 microversion: 2.20 time: 0.157240 Jul 04 09:20:25.646792 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 317/648] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:25 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:26.666744 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:26.667510 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:26.670270 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:26.676619 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:26.677118 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:26.678034 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:26.678521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:26.822847 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:26.831319 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:26.832810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:26.833918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a3570923-cafc-4903-95ce-6730d06843b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1407 microversion: 2.20 time: 0.172469 Jul 04 09:20:26.834475 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 332/649] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:26 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:27.207510 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-0881cb6c-0021-417b-ab4d-5255539c6c69 req-01f438a4-f08d-4970-a5e1-64a6b67bbb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6adb6fa-7a9a-4413-b937-aecda176cccd", "name": "network-vif-plugged", "status": "completed", "tag": "17a3b35a-43ba-4047-9cb2-8075dbd8e1e7"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:27.217088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-0881cb6c-0021-417b-ab4d-5255539c6c69 req-01f438a4-f08d-4970-a5e1-64a6b67bbb34 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:27.217532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-0881cb6c-0021-417b-ab4d-5255539c6c69 req-01f438a4-f08d-4970-a5e1-64a6b67bbb34 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:27.229531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-0881cb6c-0021-417b-ab4d-5255539c6c69 req-01f438a4-f08d-4970-a5e1-64a6b67bbb34 service nova] Creating event network-vif-plugged:17a3b35a-43ba-4047-9cb2-8075dbd8e1e7 for instance b6adb6fa-7a9a-4413-b937-aecda176cccd on hv-cinder-81914 Jul 04 09:20:27.234794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-0881cb6c-0021-417b-ab4d-5255539c6c69 req-01f438a4-f08d-4970-a5e1-64a6b67bbb34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031036 Jul 04 09:20:27.235448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 318/650] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:27.854572 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:27.855580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:27.866252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:27.867006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:27.868198 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:27.868626 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:28.020037 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:28.033061 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:28.035386 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:28.036869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2b8c377d-0d47-43b8-b532-719b9750f51e tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1407 microversion: 2.20 time: 0.188404 Jul 04 09:20:28.037720 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 333/651] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:27 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:29.054921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:29.056249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:29.062714 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:29.063673 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:29.073163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:29.073601 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:29.074403 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:29.074828 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:29.212121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:29.220313 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:29.221804 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:29.222965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-17787fc7-7bf7-4e18-adc8-d09ccca4afd1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1407 microversion: 2.20 time: 0.170161 Jul 04 09:20:29.223524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 319/652] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:29 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:30.245336 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:30.246367 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:30.249293 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:30.259383 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:30.259822 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:30.260577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:30.261034 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:30.403792 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:30.415885 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:30.417397 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:30.418585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a87021c6-564d-4de0-b6e1-3c74b0c3182c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1600 microversion: 2.20 time: 0.179968 Jul 04 09:20:30.419175 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 334/653] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:20:30 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:20:30.436184 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7c9001ea-cf00-44fb-8cb5-84ab27346690 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:30.436720 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7c9001ea-cf00-44fb-8cb5-84ab27346690 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:30.443600 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c9001ea-cf00-44fb-8cb5-84ab27346690 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:30.444108 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c9001ea-cf00-44fb-8cb5-84ab27346690 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:30.444864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c9001ea-cf00-44fb-8cb5-84ab27346690 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:30.445286 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c9001ea-cf00-44fb-8cb5-84ab27346690 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:30.533383 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7c9001ea-cf00-44fb-8cb5-84ab27346690 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100878 Jul 04 09:20:30.534246 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 320/654] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 4 09:20:30 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:20:31.528309 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-da89d933-68eb-4591-be87-667571914817 req-4cf17dcd-4dd2-404e-9bc1-15939e878299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6adb6fa-7a9a-4413-b937-aecda176cccd", "tag": "17a3b35a-43ba-4047-9cb2-8075dbd8e1e7"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:31.537131 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-da89d933-68eb-4591-be87-667571914817 req-4cf17dcd-4dd2-404e-9bc1-15939e878299 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:31.537548 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-da89d933-68eb-4591-be87-667571914817 req-4cf17dcd-4dd2-404e-9bc1-15939e878299 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:31.549730 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-da89d933-68eb-4591-be87-667571914817 req-4cf17dcd-4dd2-404e-9bc1-15939e878299 service nova] Creating event network-changed:17a3b35a-43ba-4047-9cb2-8075dbd8e1e7 for instance b6adb6fa-7a9a-4413-b937-aecda176cccd on hv-cinder-81914 Jul 04 09:20:31.554872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-da89d933-68eb-4591-be87-667571914817 req-4cf17dcd-4dd2-404e-9bc1-15939e878299 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030329 Jul 04 09:20:31.556020 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 335/655] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:35.625090 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-676454316"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:35.625712 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:35.627538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:35.633487 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:35.633851 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:35.634636 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:35.635131 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:35.771035 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.network.security_group_api [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Removing security group 69f80a40-3050-44fd-93d7-3f174d50ae61 from port 37f23b60-3209-44f8-8d9b-bff327f40798 Jul 04 09:20:36.141571 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d37a11e9-a80f-4ad3-b10e-43ccb272639b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/action" status: 202 len: 0 microversion: 2.1 time: 0.520477 Jul 04 09:20:36.146856 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 321/656] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 4 09:20:35 2022] POST /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:20:36.153502 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-559030c5-01f8-4f59-89cc-9382cebec9b6 req-2bc2b274-045a-4252-a8f5-fb0c35f3cc85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c9e64-950f-4aa9-bd4d-2304226516fb", "tag": "37f23b60-3209-44f8-8d9b-bff327f40798"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:36.172629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-559030c5-01f8-4f59-89cc-9382cebec9b6 req-2bc2b274-045a-4252-a8f5-fb0c35f3cc85 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:36.174401 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-559030c5-01f8-4f59-89cc-9382cebec9b6 req-2bc2b274-045a-4252-a8f5-fb0c35f3cc85 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:36.191388 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-559030c5-01f8-4f59-89cc-9382cebec9b6 req-2bc2b274-045a-4252-a8f5-fb0c35f3cc85 service nova] Creating event network-changed:37f23b60-3209-44f8-8d9b-bff327f40798 for instance 398c9e64-950f-4aa9-bd4d-2304226516fb on hv-cinder-81914 Jul 04 09:20:36.198102 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-559030c5-01f8-4f59-89cc-9382cebec9b6 req-2bc2b274-045a-4252-a8f5-fb0c35f3cc85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049088 Jul 04 09:20:36.201026 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 336/657] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:37.505822 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:37.506372 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:37.512925 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.513366 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:37.514172 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.514607 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:37.598159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lazy-loading 'services' on Instance uuid 398c9e64-950f-4aa9-bd4d-2304226516fb {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:20:37.719709 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c2d384fb-5e11-4346-b788-4b9cdff2b5a6 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "DELETE /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments/235f9c52-c036-435b-945d-dda33891b531" status: 202 len: 0 microversion: 2.1 time: 0.218214 Jul 04 09:20:37.720647 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 322/658] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:20:37 2022] DELETE /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments/235f9c52-c036-435b-945d-dda33891b531 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:20:37.730691 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3aeb30c8-d5fc-433f-829f-5402fa2a2ab5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:37.732003 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3aeb30c8-d5fc-433f-829f-5402fa2a2ab5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:37.738901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3aeb30c8-d5fc-433f-829f-5402fa2a2ab5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.739507 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3aeb30c8-d5fc-433f-829f-5402fa2a2ab5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:37.740355 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3aeb30c8-d5fc-433f-829f-5402fa2a2ab5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.740788 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3aeb30c8-d5fc-433f-829f-5402fa2a2ab5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:37.776206 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3aeb30c8-d5fc-433f-829f-5402fa2a2ab5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050269 Jul 04 09:20:37.776799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 337/659] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:20:37 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:38.219336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-1371d058-9a9e-4165-8f29-7b8a591d5fae req-41c4e151-f54d-4e66-a6df-4013f8c57e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c9e64-950f-4aa9-bd4d-2304226516fb", "tag": "37f23b60-3209-44f8-8d9b-bff327f40798"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:38.228668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1371d058-9a9e-4165-8f29-7b8a591d5fae req-41c4e151-f54d-4e66-a6df-4013f8c57e7d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.229305 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1371d058-9a9e-4165-8f29-7b8a591d5fae req-41c4e151-f54d-4e66-a6df-4013f8c57e7d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.240529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-1371d058-9a9e-4165-8f29-7b8a591d5fae req-41c4e151-f54d-4e66-a6df-4013f8c57e7d service nova] Creating event network-changed:37f23b60-3209-44f8-8d9b-bff327f40798 for instance 398c9e64-950f-4aa9-bd4d-2304226516fb on hv-cinder-81914 Jul 04 09:20:38.245502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-1371d058-9a9e-4165-8f29-7b8a591d5fae req-41c4e151-f54d-4e66-a6df-4013f8c57e7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030745 Jul 04 09:20:38.246362 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 323/660] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:38.788855 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5d98627c-463e-4a7a-86c5-6e016acdd9d5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:38.790484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5d98627c-463e-4a7a-86c5-6e016acdd9d5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:38.797200 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d98627c-463e-4a7a-86c5-6e016acdd9d5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.797650 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d98627c-463e-4a7a-86c5-6e016acdd9d5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.798433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d98627c-463e-4a7a-86c5-6e016acdd9d5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.798894 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5d98627c-463e-4a7a-86c5-6e016acdd9d5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.830076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5d98627c-463e-4a7a-86c5-6e016acdd9d5 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045168 Jul 04 09:20:38.830884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 338/661] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:20:38 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:20:38.842469 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:38.843016 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:38.849631 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.850101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.850849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.851276 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.925357 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] HTTP exception thrown: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb is not attached to volume 235f9c52-c036-435b-945d-dda33891b531 Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Request method failure captured: Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments/235f9c52-c036-435b-945d-dda33891b531 HTTP/1.1 Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrBaI8LJyCgNEOPTaZ3ZYQ02R7IBpmiK4x910-6tuIcMgPbirltjd2XK2_kvPYuMC7pFloAu7RE0mpzD0yIOkM5ILCtdTpFJun_Vpe5xHUGX6jts2Fs196DAn4vwKXXLIeOUEmeTeURdF1SAs5LtWUFBleENw0Lv1zjs_Bi0yvdJcAE Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 8a4eaafcb5814b92a0c740931fcf422d Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestMinimumBasicScenario-642745368 Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:20:38.927754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a4eaafcb5814b92a0c740931fcf422d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a4eaafcb5814b92a0c740931fcf422d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a4eaafcb5814b92a0c740931fcf422d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a4eaafcb5814b92a0c740931fcf422d"}]}] Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestMinimumBasicScenario-642745368 Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 8a4eaafcb5814b92a0c740931fcf422d Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestMinimumBasicScenario-642745368 Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-TestMinimumBasicScenario-642745368-project Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: a9dfef8fef8d45d99636579271c71d51 Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestMinimumBasicScenario-642745368-project Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:20:38.929325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb is not attached to volume 235f9c52-c036-435b-945d-dda33891b531 Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'server_id': '398c9e64-950f-4aa9-bd4d-2304226516fb', 'id': '235f9c52-c036-435b-945d-dda33891b531'} Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 235f9c52-c036-435b-945d-dda33891b531. Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:38.930129 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb is not attached to volume 235f9c52-c036-435b-945d-dda33891b531 Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb is not attached to volume 235f9c52-c036-435b-945d-dda33891b531 Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:20:38.931412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Returning 404 to user: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb is not attached to volume 235f9c52-c036-435b-945d-dda33891b531 {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:38.932438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6095d014-7e5f-4a4f-a1e0-952a7e75f29b tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "DELETE /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments/235f9c52-c036-435b-945d-dda33891b531" status: 404 len: 154 microversion: 2.1 time: 0.092131 Jul 04 09:20:38.932438 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 324/662] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:20:38 2022] DELETE /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb/os-volume_attachments/235f9c52-c036-435b-945d-dda33891b531 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:40.088937 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:40.089578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:40.096143 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.096591 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:40.097350 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.097782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:40.122193 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:20:40.202269 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-58787bef-10bd-402b-98d4-2efe4582eb93 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "DELETE /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 204 len: 0 microversion: 2.1 time: 0.116731 Jul 04 09:20:40.202961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 339/663] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:20:40 2022] DELETE /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:20:40.211357 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:40.211968 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:40.219150 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.219592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:40.220349 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.220778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:40.347942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:40.356282 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b9e9a455-b866-4797-a391-6e8d03018fb4 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1554 microversion: 2.1 time: 0.148793 Jul 04 09:20:40.356859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 325/664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:40 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:41.379530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:41.380672 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:41.392252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:41.392986 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:41.394298 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:41.395008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:41.534428 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:41.543035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6f0d3385-3599-485f-9571-c9143ce62092 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1554 microversion: 2.1 time: 0.170628 Jul 04 09:20:41.543588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 340/665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:41 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:41.983457 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-01cb94fb-0fdd-4e38-b654-2cd29281f5ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:41.984165 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-01cb94fb-0fdd-4e38-b654-2cd29281f5ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:41.993944 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-01cb94fb-0fdd-4e38-b654-2cd29281f5ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:41.994423 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-01cb94fb-0fdd-4e38-b654-2cd29281f5ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:41.995302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-01cb94fb-0fdd-4e38-b654-2cd29281f5ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:41.995944 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-01cb94fb-0fdd-4e38-b654-2cd29281f5ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.019274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-01cb94fb-0fdd-4e38-b654-2cd29281f5ab tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/ips" status: 200 len: 145 microversion: 2.1 time: 0.042155 Jul 04 09:20:42.019842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 326/666] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:20:41 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:42.562385 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:42.563883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:42.573371 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.574046 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.575076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.575746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.639748 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-f4411799-1b99-4016-8e6a-678f0bbb93dd req-77a45e7d-edde-4443-a11b-0236b61370ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398c9e64-950f-4aa9-bd4d-2304226516fb", "name": "network-vif-deleted", "tag": "37f23b60-3209-44f8-8d9b-bff327f40798"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:42.648850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f4411799-1b99-4016-8e6a-678f0bbb93dd req-77a45e7d-edde-4443-a11b-0236b61370ac service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.649289 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f4411799-1b99-4016-8e6a-678f0bbb93dd req-77a45e7d-edde-4443-a11b-0236b61370ac service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.661261 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-f4411799-1b99-4016-8e6a-678f0bbb93dd req-77a45e7d-edde-4443-a11b-0236b61370ac service nova] Creating event network-vif-deleted:37f23b60-3209-44f8-8d9b-bff327f40798 for instance 398c9e64-950f-4aa9-bd4d-2304226516fb on hv-cinder-81914 Jul 04 09:20:42.662327 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dfef8fef8d45d99636579271c71d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4eaafcb5814b92a0c740931fcf422d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:42.666002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-f4411799-1b99-4016-8e6a-678f0bbb93dd req-77a45e7d-edde-4443-a11b-0236b61370ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030231 Jul 04 09:20:42.666596 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 327/667] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:42.674723 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-624f665f-e0b9-49a4-965d-a98003d7a3f7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 200 len: 1512 microversion: 2.1 time: 0.117579 Jul 04 09:20:42.675307 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 341/668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:42 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 1512 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:43.353828 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3c739546-0c0a-4e55-8aa4-68f1997720a3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04b4eee5-88e4-4caa-ba94-415a9f8adf93"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:43.355480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3c739546-0c0a-4e55-8aa4-68f1997720a3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:43.362197 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c739546-0c0a-4e55-8aa4-68f1997720a3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:43.362660 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c739546-0c0a-4e55-8aa4-68f1997720a3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:43.363424 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c739546-0c0a-4e55-8aa4-68f1997720a3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:43.363858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c739546-0c0a-4e55-8aa4-68f1997720a3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:43.612555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:43.623476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3c739546-0c0a-4e55-8aa4-68f1997720a3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274533 Jul 04 09:20:43.624099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 328/669] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:20:43 2022] POST /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:43.692419 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:43.693223 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] [instance: 398c9e64-950f-4aa9-bd4d-2304226516fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:43.700116 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:43.700555 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:43.701421 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:43.701949 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:43.716757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] HTTP exception thrown: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb could not be found. Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Request method failure captured: Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb HTTP/1.1 Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrBaI8LJyCgNEOPTaZ3ZYQ02R7IBpmiK4x910-6tuIcMgPbirltjd2XK2_kvPYuMC7pFloAu7RE0mpzD0yIOkM5ILCtdTpFJun_Vpe5xHUGX6jts2Fs196DAn4vwKXXLIeOUEmeTeURdF1SAs5LtWUFBleENw0Lv1zjs_Bi0yvdJcAE Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 8a4eaafcb5814b92a0c740931fcf422d Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-TestMinimumBasicScenario-642745368 Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:20:43.718431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a4eaafcb5814b92a0c740931fcf422d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a4eaafcb5814b92a0c740931fcf422d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a4eaafcb5814b92a0c740931fcf422d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a4eaafcb5814b92a0c740931fcf422d"}]}] Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-TestMinimumBasicScenario-642745368 Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 8a4eaafcb5814b92a0c740931fcf422d Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-TestMinimumBasicScenario-642745368 Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-TestMinimumBasicScenario-642745368-project Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: a9dfef8fef8d45d99636579271c71d51 Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-TestMinimumBasicScenario-642745368-project Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb could not be found. Jul 04 09:20:43.720030 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '398c9e64-950f-4aa9-bd4d-2304226516fb'} Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb could not be found. Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:43.721212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb could not be found. Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb could not be found. Jul 04 09:20:43.722761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:43.724495 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Returning 404 to user: Instance 398c9e64-950f-4aa9-bd4d-2304226516fb could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:43.724495 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-95211dd2-b04f-4695-8581-6e02ac4fb8b7 tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb" status: 404 len: 111 microversion: 2.1 time: 0.031272 Jul 04 09:20:43.724495 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 342/670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:43 2022] GET /compute/v2.1/servers/398c9e64-950f-4aa9-bd4d-2304226516fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:43.729396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3e312bab-6900-4e95-be32-c99666a3a50c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] Calling method '.version_select at 0x7f8e810d33a0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:43.749151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3e312bab-6900-4e95-be32-c99666a3a50c tempest-TestMinimumBasicScenario-642745368 tempest-TestMinimumBasicScenario-642745368-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1265907453" status: 202 len: 0 microversion: 2.1 time: 0.024209 Jul 04 09:20:43.749724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 329/671] 10.222.0.26 () {58 vars in 1271 bytes} [Mon Jul 4 09:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1265907453 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:20:44.461992 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:44.462452 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:44.469869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.470560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.471682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.472159 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.499204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:20:44.513489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:44.581947 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f13fd9f3-17bb-4e43-a819-f331463f429a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 204 len: 0 microversion: 2.1 time: 0.123387 Jul 04 09:20:44.582824 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 343/672] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:20:44 2022] DELETE /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:20:44.591690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:44.592478 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:44.599661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.600189 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.601020 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.601518 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.741610 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:44.749301 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fe23b810-b65c-421f-a165-5d7488b6c12a tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1579 microversion: 2.1 time: 0.162333 Jul 04 09:20:44.749794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 330/673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:44 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:45.768592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:45.769204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:45.776256 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:45.777013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:45.778864 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:45.779354 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:46.043814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:46.052956 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-171385bb-4560-4e0a-b7f2-69bc7500f0fc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1579 microversion: 2.1 time: 0.289088 Jul 04 09:20:46.053516 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 344/674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:45 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1579 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:47.071308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:47.072175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:47.079559 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.092207 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.093448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.095042 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.457033 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:47.465651 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e16d0180-b544-4d8e-ab8e-ca70d373acc9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1579 microversion: 2.1 time: 0.398328 Jul 04 09:20:47.475037 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 331/675] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:47 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1579 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:47.812374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-38264075-179e-43f5-8d0b-e7f9f95663f0 req-8453a24e-9a45-4c87-8f0a-49ff49a6d120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4c41fd-607b-4420-9719-5e0b6a2f47f2", "name": "network-vif-deleted", "tag": "a4e977c6-a145-4cde-899f-60464a853272"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:47.823455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-38264075-179e-43f5-8d0b-e7f9f95663f0 req-8453a24e-9a45-4c87-8f0a-49ff49a6d120 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.824578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-38264075-179e-43f5-8d0b-e7f9f95663f0 req-8453a24e-9a45-4c87-8f0a-49ff49a6d120 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.860443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-38264075-179e-43f5-8d0b-e7f9f95663f0 req-8453a24e-9a45-4c87-8f0a-49ff49a6d120 service nova] Creating event network-vif-deleted:a4e977c6-a145-4cde-899f-60464a853272 for instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 on hv-cinder-81914 Jul 04 09:20:47.869716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-38264075-179e-43f5-8d0b-e7f9f95663f0 req-8453a24e-9a45-4c87-8f0a-49ff49a6d120 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061548 Jul 04 09:20:47.874799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 345/676] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:48.483787 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:48.484422 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:48.491191 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:48.491629 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:48.492398 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:48.492823 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:48.529130 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:48.529762 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:48.530463 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lazy-loading 'fault' on Instance uuid 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:20:48.580799 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:48.594673 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-858d4c3f-7b4a-485d-b02c-4fff7f22637b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 200 len: 1230 microversion: 2.1 time: 0.114951 Jul 04 09:20:48.598819 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 332/677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:48 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:49.616573 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:49.617447 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:49.624388 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:49.624844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:49.625660 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:49.626125 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:49.642732 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] HTTP exception thrown: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Request method failure captured: Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 HTTP/1.1 Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrAkoWWc056TIRHLrlx_PSvDGUZGwshxb7PxoBovvSj8jpJwsis-vHHAITWeTxRmVib72xBBKk1GVSDTLDQvV6Sox2PkffZj1kJV5d_WaQsqTkVAkMFkT_JRx8GATCSHVWV8c5Z-etGTqpxfgEV2nkzyxZOAaJQP-iW1l5kFyXLWFEY Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:20:49.644417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc462a5ff5f649cdb9a24f2232855724", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc462a5ff5f649cdb9a24f2232855724"}]}] Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: f884304cbb764a8ab4927c3ba8db892d Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:20:49.646180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '4a4c41fd-607b-4420-9719-5e0b6a2f47f2'} Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:49.649139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:20:49.650815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:20:49.652234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Returning 404 to user: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:49.652234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0cf51398-474d-4a0a-938d-09da17fea172 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 404 len: 111 microversion: 2.1 time: 0.034391 Jul 04 09:20:49.652234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 346/678] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:49 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:49.773969 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-996282241", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-673347094", "security_groups": [{"name": "tempest-secgroup-smoke-1779143404"}], "block_device_mapping_v2": [{"uuid": "a200a09d-a17c-49e3-8524-7f8c9fab1df5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "956432d6-39cd-4134-be04-9d32af252f5a"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:49.888928 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] validate_networks() for [('956432d6-39cd-4134-be04-9d32af252f5a', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:20:50.188456 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0571575b-787c-43c1-9484-c62aebe73282 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:50.189618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0571575b-787c-43c1-9484-c62aebe73282 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:50.196128 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0571575b-787c-43c1-9484-c62aebe73282 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.196814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0571575b-787c-43c1-9484-c62aebe73282 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.197748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0571575b-787c-43c1-9484-c62aebe73282 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.198407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0571575b-787c-43c1-9484-c62aebe73282 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.239002 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0571575b-787c-43c1-9484-c62aebe73282 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054501 Jul 04 09:20:50.246373 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 347/679] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:20:50 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:50.252248 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fa7a2a8b-0a86-4090-80dd-9ad40f17f7a7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:50.252978 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fa7a2a8b-0a86-4090-80dd-9ad40f17f7a7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:50.259651 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa7a2a8b-0a86-4090-80dd-9ad40f17f7a7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.261500 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa7a2a8b-0a86-4090-80dd-9ad40f17f7a7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.262474 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa7a2a8b-0a86-4090-80dd-9ad40f17f7a7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.263059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fa7a2a8b-0a86-4090-80dd-9ad40f17f7a7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.295961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fa7a2a8b-0a86-4090-80dd-9ad40f17f7a7 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/04b4eee5-88e4-4caa-ba94-415a9f8adf93" status: 200 len: 194 microversion: 2.1 time: 0.047658 Jul 04 09:20:50.296843 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 348/680] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jul 4 09:20:50 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/04b4eee5-88e4-4caa-ba94-415a9f8adf93 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:50.357047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:20:50.357227 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:20:50.357664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:20:50.358103 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:20:50.358562 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:20:50.370740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.372206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.373550 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.374322 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.394786 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for project dc462a5ff5f649cdb9a24f2232855724. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:50.399892 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for user f884304cbb764a8ab4927c3ba8db892d and project dc462a5ff5f649cdb9a24f2232855724. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:50.473596 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:20:50.476385 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a200a09d-a17c-49e3-8524-7f8c9fab1df5',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:20:50.732419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3b6dfab3-e074-4986-8a00-16cfc394bf29 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.962270 Jul 04 09:20:50.733100 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 333/681] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:20:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:20:50.743293 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f201c4a6-a1da-4afb-abd5-e7ea2d1658c1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:50.743935 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f201c4a6-a1da-4afb-abd5-e7ea2d1658c1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:50.856568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f201c4a6-a1da-4afb-abd5-e7ea2d1658c1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:50.865146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f201c4a6-a1da-4afb-abd5-e7ea2d1658c1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1093 microversion: 2.1 time: 0.125806 Jul 04 09:20:50.866370 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 349/682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:50 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1093 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:51.779054 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-49f6e5df-b779-4fc7-890d-26a6e3ea495c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "041086a7-777a-4a5a-b88d-757f6682bc9c"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:51.780323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-49f6e5df-b779-4fc7-890d-26a6e3ea495c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:51.793675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49f6e5df-b779-4fc7-890d-26a6e3ea495c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.794188 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49f6e5df-b779-4fc7-890d-26a6e3ea495c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.794930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49f6e5df-b779-4fc7-890d-26a6e3ea495c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.795358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49f6e5df-b779-4fc7-890d-26a6e3ea495c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.883363 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:51.884151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:51.903100 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.903961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.905605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.907331 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:52.043538 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:52.061520 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ccd0165e-d778-4fd4-bf14-af1f21951c5e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1199 microversion: 2.1 time: 0.182569 Jul 04 09:20:52.062182 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 350/683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:51 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1199 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:52.221513 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-49f6e5df-b779-4fc7-890d-26a6e3ea495c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "POST /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447303 Jul 04 09:20:52.223011 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 334/684] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:20:51 2022] POST /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:53.079649 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:53.080323 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:53.087515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.089620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.090582 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.091100 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.456487 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:53.467536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-31be98d3-5a8c-4a80-b481-9190b3e84330 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.392101 Jul 04 09:20:53.468150 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 351/685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:53 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:53.827312 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-f22e77c4-fe8d-4ecc-9607-72b51f29f2ae req-085f1de7-96f4-4376-a219-0ba0e5111700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bd7f0c-e581-405e-b37f-58634f0d1286", "tag": "d16716ae-e351-4c48-88e0-7c8705d47ca0"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:53.837839 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f22e77c4-fe8d-4ecc-9607-72b51f29f2ae req-085f1de7-96f4-4376-a219-0ba0e5111700 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.838249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f22e77c4-fe8d-4ecc-9607-72b51f29f2ae req-085f1de7-96f4-4376-a219-0ba0e5111700 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.853215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-f22e77c4-fe8d-4ecc-9607-72b51f29f2ae req-085f1de7-96f4-4376-a219-0ba0e5111700 service nova] Creating event network-changed:d16716ae-e351-4c48-88e0-7c8705d47ca0 for instance 91bd7f0c-e581-405e-b37f-58634f0d1286 on hv-cinder-81914 Jul 04 09:20:53.858159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-f22e77c4-fe8d-4ecc-9607-72b51f29f2ae req-085f1de7-96f4-4376-a219-0ba0e5111700 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039221 Jul 04 09:20:53.858768 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 335/686] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:54.490186 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:54.491079 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:54.501967 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:54.502707 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:54.503954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:54.504663 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:54.732471 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:54.740180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ecf2b07d-875a-4256-a70b-1464d5005607 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.256680 Jul 04 09:20:54.740819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 352/687] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:54 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:55.763280 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:55.763945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:55.772094 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:55.772641 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:55.773505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:55.774074 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:55.916797 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:55.925345 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-254a3702-14f3-48ac-aefd-dd4664ab9376 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.169784 Jul 04 09:20:55.925928 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 336/688] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:55 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:56.946604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:56.947559 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:56.951404 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:56.960257 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.960985 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.962312 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.963018 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.095681 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:57.107356 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-112c137a-2f62-4050-a067-cb8db4d81f92 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.166939 Jul 04 09:20:57.108118 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 353/689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:56 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:58.128657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:58.129613 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:58.138942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.139394 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.140159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.140593 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.271611 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:58.282883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7d0d3a68-a33d-4ac0-8091-a68365611507 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.160530 Jul 04 09:20:58.283661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 337/690] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:58 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:59.302923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:59.303524 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:59.310580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.310998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.311797 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.312226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.450389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:59.457986 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-61f44eff-c504-47c3-a567-a67bff97f799 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.158976 Jul 04 09:20:59.458557 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 354/691] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:59 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:59.773777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1077d35d-2b1e-4c9c-bc6c-35e134fbc4f9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:59.774737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1077d35d-2b1e-4c9c-bc6c-35e134fbc4f9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:59.781547 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1077d35d-2b1e-4c9c-bc6c-35e134fbc4f9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.782018 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1077d35d-2b1e-4c9c-bc6c-35e134fbc4f9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.782783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1077d35d-2b1e-4c9c-bc6c-35e134fbc4f9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.783209 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1077d35d-2b1e-4c9c-bc6c-35e134fbc4f9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.812964 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1077d35d-2b1e-4c9c-bc6c-35e134fbc4f9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043086 Jul 04 09:20:59.813514 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 338/692] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:20:59 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:59.966300 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-69e4f18e-5fb4-40b2-b732-accef50138c3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:59.966728 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-69e4f18e-5fb4-40b2-b732-accef50138c3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:59.973149 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69e4f18e-5fb4-40b2-b732-accef50138c3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.973596 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69e4f18e-5fb4-40b2-b732-accef50138c3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.974395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69e4f18e-5fb4-40b2-b732-accef50138c3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.974829 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69e4f18e-5fb4-40b2-b732-accef50138c3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.005075 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-69e4f18e-5fb4-40b2-b732-accef50138c3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/04b4eee5-88e4-4caa-ba94-415a9f8adf93" status: 200 len: 194 microversion: 2.1 time: 0.043734 Jul 04 09:21:00.005666 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 355/693] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jul 4 09:20:59 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/04b4eee5-88e4-4caa-ba94-415a9f8adf93 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:00.015786 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:00.016274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:00.022874 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.023322 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.024080 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.024511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.114711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lazy-loading 'services' on Instance uuid d44fe99f-2d33-48fc-8093-0b98e37ce8e2 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:00.189825 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a43ff577-ad47-480c-b31d-2bb2a1186f2c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/04b4eee5-88e4-4caa-ba94-415a9f8adf93" status: 202 len: 0 microversion: 2.1 time: 0.177854 Jul 04 09:21:00.190450 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 339/694] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:21:00 2022] DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/04b4eee5-88e4-4caa-ba94-415a9f8adf93 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:21:00.479164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:00.479787 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:00.486960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.487377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.488147 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.488585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.624927 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:00.633246 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e5c56050-f472-4004-bb80-211477b72e41 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.160534 Jul 04 09:21:00.633799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 356/695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:00 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:01.653627 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:01.654543 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:01.659700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:01.660399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:01.668495 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.668938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.669711 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.670177 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.808112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:01.816244 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fa112bfb-7053-413f-b8c8-beaa5aac412c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.164304 Jul 04 09:21:01.816846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 340/696] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:01 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:02.374231 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1c682186-53b8-4a28-80cf-f861177e1ec9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:02.374780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1c682186-53b8-4a28-80cf-f861177e1ec9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:02.376535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:02.382677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1c682186-53b8-4a28-80cf-f861177e1ec9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.383121 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1c682186-53b8-4a28-80cf-f861177e1ec9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.383877 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1c682186-53b8-4a28-80cf-f861177e1ec9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.384301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1c682186-53b8-4a28-80cf-f861177e1ec9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.413251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1c682186-53b8-4a28-80cf-f861177e1ec9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/041086a7-777a-4a5a-b88d-757f6682bc9c" status: 200 len: 194 microversion: 2.1 time: 0.043045 Jul 04 09:21:02.413831 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 357/697] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jul 4 09:21:02 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/041086a7-777a-4a5a-b88d-757f6682bc9c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:02.423970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:02.424468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:02.431003 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.431885 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.433210 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.434011 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.526871 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lazy-loading 'services' on Instance uuid d44fe99f-2d33-48fc-8093-0b98e37ce8e2 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:02.612197 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f1e08574-b143-4bbf-82f0-0f018aaa44e3 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/041086a7-777a-4a5a-b88d-757f6682bc9c" status: 202 len: 0 microversion: 2.1 time: 0.191977 Jul 04 09:21:02.612787 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 341/698] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:21:02 2022] DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments/041086a7-777a-4a5a-b88d-757f6682bc9c => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:21:02.840398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:02.841399 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:02.848554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.848992 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.849760 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.850315 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.999208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.011503 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-30c67917-5b3c-4c50-9c0d-63b92756187e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.180151 Jul 04 09:21:03.012432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 358/699] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:02 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:03.523276 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-ef96c8cb-dec9-4e45-a7d4-0902acf09e63 req-c9c1a5d5-3f4e-4b4d-9900-c6c80aaa9d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bd7f0c-e581-405e-b37f-58634f0d1286", "name": "network-vif-plugged", "status": "completed", "tag": "d16716ae-e351-4c48-88e0-7c8705d47ca0"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:03.531732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ef96c8cb-dec9-4e45-a7d4-0902acf09e63 req-c9c1a5d5-3f4e-4b4d-9900-c6c80aaa9d7d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.532241 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ef96c8cb-dec9-4e45-a7d4-0902acf09e63 req-c9c1a5d5-3f4e-4b4d-9900-c6c80aaa9d7d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.543514 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-ef96c8cb-dec9-4e45-a7d4-0902acf09e63 req-c9c1a5d5-3f4e-4b4d-9900-c6c80aaa9d7d service nova] Creating event network-vif-plugged:d16716ae-e351-4c48-88e0-7c8705d47ca0 for instance 91bd7f0c-e581-405e-b37f-58634f0d1286 on hv-cinder-81914 Jul 04 09:21:03.548264 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-ef96c8cb-dec9-4e45-a7d4-0902acf09e63 req-c9c1a5d5-3f4e-4b4d-9900-c6c80aaa9d7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226887 Jul 04 09:21:03.548837 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 342/700] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:03.786749 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-df7afda4-92c8-4897-8c2b-266f95eb5f3f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:03.787649 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-df7afda4-92c8-4897-8c2b-266f95eb5f3f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.794522 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-df7afda4-92c8-4897-8c2b-266f95eb5f3f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.794967 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-df7afda4-92c8-4897-8c2b-266f95eb5f3f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.795738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-df7afda4-92c8-4897-8c2b-266f95eb5f3f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.796160 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-df7afda4-92c8-4897-8c2b-266f95eb5f3f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.826002 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-df7afda4-92c8-4897-8c2b-266f95eb5f3f tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043105 Jul 04 09:21:03.826570 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 359/701] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:21:03 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:21:03.945553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8a30344b-e7b6-4779-bfd7-3c44d09baaec tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:03.946541 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8a30344b-e7b6-4779-bfd7-3c44d09baaec tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.953254 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a30344b-e7b6-4779-bfd7-3c44d09baaec tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.953735 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a30344b-e7b6-4779-bfd7-3c44d09baaec tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.954649 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a30344b-e7b6-4779-bfd7-3c44d09baaec tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.955083 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a30344b-e7b6-4779-bfd7-3c44d09baaec tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.985216 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8a30344b-e7b6-4779-bfd7-3c44d09baaec tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044027 Jul 04 09:21:03.985790 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 343/702] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:21:03 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:21:04.029918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:04.030544 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:04.040294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.040294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.040294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.040294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.052525 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:04.053020 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:04.059941 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.060388 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.061156 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.061607 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.087206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:21:04.115604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:04.176804 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cd3b9e9b-5a1e-433a-95b8-d658d12589c8 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 204 len: 0 microversion: 2.1 time: 0.127811 Jul 04 09:21:04.177930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 344/703] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:21:04 2022] DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:21:04.185677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:04.185927 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:04.186552 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:04.193290 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-241635cd-486c-46ac-b4fb-45db1ab1c0bc tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.167549 Jul 04 09:21:04.193449 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.193837 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.194014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 360/704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:04 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:04.194636 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.195076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.330890 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:04.338514 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-addbdbb0-5b7a-40ea-8429-cbb76c64b112 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1673 microversion: 2.1 time: 0.156736 Jul 04 09:21:04.339176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 345/705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:04 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:05.210463 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:05.211041 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:05.218656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.219107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.219881 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.220321 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.238732 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:05.355917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:05.356494 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:05.363133 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:05.363440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.363913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.364723 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.365365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.371514 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6a8325a7-4e6c-4cac-841d-360ea93ab77c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.164853 Jul 04 09:21:05.372301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 361/706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:05 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:05.507339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:05.515377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-389a3795-80ec-4311-8f81-52ce9a5d0491 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1673 microversion: 2.1 time: 0.163598 Jul 04 09:21:05.515994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 346/707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:05 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:06.388719 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:06.389332 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:06.396409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.396854 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.397607 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.398070 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.532816 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:06.533341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:06.534329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.535907 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:06.541453 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.541923 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.542417 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-12042593-c86b-43be-a4c4-1b5a7a5d06ef tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1265 microversion: 2.1 time: 0.157780 Jul 04 09:21:06.542770 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.543218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 362/708] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:06 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:06.543332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.685428 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.693411 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2400dd39-a42b-45e4-a94e-5e35fbf92de9 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1673 microversion: 2.1 time: 0.164485 Jul 04 09:21:06.694060 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 347/709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:06 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:07.560884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.561634 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.569590 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.570263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.571093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.571737 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.573757 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-dd9fb9b3-4623-4b77-9fd6-368b7734dafe req-5381dae5-3548-4401-8ea6-2dfeb21d2b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44fe99f-2d33-48fc-8093-0b98e37ce8e2", "name": "network-vif-deleted", "tag": "8cde69f6-6a15-4f69-a13f-6914787dd859"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:07.582029 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-dd9fb9b3-4623-4b77-9fd6-368b7734dafe req-5381dae5-3548-4401-8ea6-2dfeb21d2b86 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.582464 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-dd9fb9b3-4623-4b77-9fd6-368b7734dafe req-5381dae5-3548-4401-8ea6-2dfeb21d2b86 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.594303 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-dd9fb9b3-4623-4b77-9fd6-368b7734dafe req-5381dae5-3548-4401-8ea6-2dfeb21d2b86 service nova] Creating event network-vif-deleted:8cde69f6-6a15-4f69-a13f-6914787dd859 for instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 on hv-cinder-81914 Jul 04 09:21:07.599196 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-dd9fb9b3-4623-4b77-9fd6-368b7734dafe req-5381dae5-3548-4401-8ea6-2dfeb21d2b86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029554 Jul 04 09:21:07.599798 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 348/710] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:21:07.711616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.712341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.725019 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.725862 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.727081 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.728231 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.728349 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.738759 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-12245969-331c-466d-b446-f743bf338c22 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1453 microversion: 2.1 time: 0.182075 Jul 04 09:21:07.739729 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 363/711] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:07.755374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.755987 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.762966 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.763508 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.764355 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.764790 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.783578 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.784877 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.785679 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lazy-loading 'fault' on Instance uuid d44fe99f-2d33-48fc-8093-0b98e37ce8e2 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:07.837818 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcd8fb25604011bfd1df823ea4ddad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfd9d65f66641b2bda6bbdcf908ca3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.846309 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-66935d89-a49e-4a01-8512-01af650c8d59 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 200 len: 1327 microversion: 2.1 time: 0.138738 Jul 04 09:21:07.857465 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 349/712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:07.929455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.938378 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fd18c350-a9be-4691-87ff-f09211c2146d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1453 microversion: 2.1 time: 0.186920 Jul 04 09:21:07.938977 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 364/713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:08.864185 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:08.864761 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:08.872004 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.872441 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.873201 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.873621 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.887580 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] HTTP exception thrown: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Request method failure captured: Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 HTTP/1.1 Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-TbVC9IxUcogbz4WKLEhB6UjJJxaTEPQHY7QO-sYycLFebqvFobElVsMcLMnmk-F-QuorUCgIVQbgBuBzyacfZvdhlbIn7hJkV4ADa1DL0kf6iHM-YQ5xFamuo6kEguJ0HKtLVzXVHBjQouxNrQCy-a4nt7raDx84Fxhu_JmMSq4M Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:21:08.889219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cfd9d65f66641b2bda6bbdcf908ca3c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}] Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 43bcd8fb25604011bfd1df823ea4ddad Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:08.890589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'd44fe99f-2d33-48fc-8093-0b98e37ce8e2'} Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:08.891377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:08.892931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:08.894921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Returning 404 to user: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:08.894921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b6700f8f-1f17-44cb-bdcf-e7709698dfbe tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 404 len: 111 microversion: 2.1 time: 0.030816 Jul 04 09:21:08.894921 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 350/714] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:08 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:21:08.900558 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b3090797-1cae-43eb-a2cc-e8e7d5a2cc3b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '.version_select at 0x7f8e80ee54c0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:08.919804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b3090797-1cae-43eb-a2cc-e8e7d5a2cc3b tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640035807" status: 202 len: 0 microversion: 2.1 time: 0.023164 Jul 04 09:21:08.920387 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 365/715] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 4 09:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640035807 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:21:09.616733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-999c75ee-c7d8-43c0-9185-ee2e91c9e6a6 req-1dff1627-78ca-4818-b34b-93e082385db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bd7f0c-e581-405e-b37f-58634f0d1286", "tag": "d16716ae-e351-4c48-88e0-7c8705d47ca0"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:09.626292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-999c75ee-c7d8-43c0-9185-ee2e91c9e6a6 req-1dff1627-78ca-4818-b34b-93e082385db0 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.626739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-999c75ee-c7d8-43c0-9185-ee2e91c9e6a6 req-1dff1627-78ca-4818-b34b-93e082385db0 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.640113 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-999c75ee-c7d8-43c0-9185-ee2e91c9e6a6 req-1dff1627-78ca-4818-b34b-93e082385db0 service nova] Creating event network-changed:d16716ae-e351-4c48-88e0-7c8705d47ca0 for instance 91bd7f0c-e581-405e-b37f-58634f0d1286 on hv-cinder-81914 Jul 04 09:21:09.646171 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-999c75ee-c7d8-43c0-9185-ee2e91c9e6a6 req-1dff1627-78ca-4818-b34b-93e082385db0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033491 Jul 04 09:21:09.647002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 351/716] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:11.852019 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:11.852526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:11.860431 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.860872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.861633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.862110 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.875192 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] HTTP exception thrown: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Request method failure captured: Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 HTTP/1.1 Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-TbVC9IxUcogbz4WKLEhB6UjJJxaTEPQHY7QO-sYycLFebqvFobElVsMcLMnmk-F-QuorUCgIVQbgBuBzyacfZvdhlbIn7hJkV4ADa1DL0kf6iHM-YQ5xFamuo6kEguJ0HKtLVzXVHBjQouxNrQCy-a4nt7raDx84Fxhu_JmMSq4M Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:21:11.876724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cfd9d65f66641b2bda6bbdcf908ca3c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}] Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 43bcd8fb25604011bfd1df823ea4ddad Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.878329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'd44fe99f-2d33-48fc-8093-0b98e37ce8e2'} Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:11.879187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.880618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.882095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Returning 404 to user: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:11.882095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-230d1fd7-360d-42d1-9d8d-62074e6beec6 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 404 len: 111 microversion: 2.1 time: 0.029969 Jul 04 09:21:11.882095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 366/717] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:21:11 2022] DELETE /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:21:11.887672 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:11.888292 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: d44fe99f-2d33-48fc-8093-0b98e37ce8e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:11.896223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.896697 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.897469 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.897928 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.911142 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] HTTP exception thrown: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Request method failure captured: Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 HTTP/1.1 Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-TbVC9IxUcogbz4WKLEhB6UjJJxaTEPQHY7QO-sYycLFebqvFobElVsMcLMnmk-F-QuorUCgIVQbgBuBzyacfZvdhlbIn7hJkV4ADa1DL0kf6iHM-YQ5xFamuo6kEguJ0HKtLVzXVHBjQouxNrQCy-a4nt7raDx84Fxhu_JmMSq4M Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:21:11.912731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cfd9d65f66641b2bda6bbdcf908ca3c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}] Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 43bcd8fb25604011bfd1df823ea4ddad Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.914350 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'd44fe99f-2d33-48fc-8093-0b98e37ce8e2'} Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:11.915245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. Jul 04 09:21:11.916599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:11.918119 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Returning 404 to user: Instance d44fe99f-2d33-48fc-8093-0b98e37ce8e2 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:11.918119 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-26739d80-66e2-4b02-96c4-fdcb81ce970e tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2" status: 404 len: 111 microversion: 2.1 time: 0.030780 Jul 04 09:21:11.918119 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 352/718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:11 2022] GET /compute/v2.1/servers/d44fe99f-2d33-48fc-8093-0b98e37ce8e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:21:13.055595 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:13.056097 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:13.063337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.063783 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.064542 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.064973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.078852 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] HTTP exception thrown: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Request method failure captured: Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: DELETE /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 HTTP/1.1 Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwq-TbVC9IxUcogbz4WKLEhB6UjJJxaTEPQHY7QO-sYycLFebqvFobElVsMcLMnmk-F-QuorUCgIVQbgBuBzyacfZvdhlbIn7hJkV4ADa1DL0kf6iHM-YQ5xFamuo6kEguJ0HKtLVzXVHBjQouxNrQCy-a4nt7raDx84Fxhu_JmMSq4M Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:21:13.080393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cfd9d65f66641b2bda6bbdcf908ca3c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}] Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 43bcd8fb25604011bfd1df823ea4ddad Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.081869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'b908667b-9eab-4249-b81a-acd8c6e40e86'} Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:13.082757 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.084017 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.085611 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Returning 404 to user: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:13.085611 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4be583c7-0237-4b18-9091-2b200d6e414c tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 404 len: 111 microversion: 2.1 time: 0.030076 Jul 04 09:21:13.085611 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 367/719] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:21:13 2022] DELETE /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:21:13.090633 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:13.091273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] [instance: b908667b-9eab-4249-b81a-acd8c6e40e86] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:13.098175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.098622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.099382 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.099812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.113412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] HTTP exception thrown: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Request method failure captured: Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 HTTP/1.1 Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq-TbVC9IxUcogbz4WKLEhB6UjJJxaTEPQHY7QO-sYycLFebqvFobElVsMcLMnmk-F-QuorUCgIVQbgBuBzyacfZvdhlbIn7hJkV4ADa1DL0kf6iHM-YQ5xFamuo6kEguJ0HKtLVzXVHBjQouxNrQCy-a4nt7raDx84Fxhu_JmMSq4M Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:21:13.115006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cfd9d65f66641b2bda6bbdcf908ca3c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cfd9d65f66641b2bda6bbdcf908ca3c"}]}] Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 8cfd9d65f66641b2bda6bbdcf908ca3c Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2143096836 Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 43bcd8fb25604011bfd1df823ea4ddad Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-2143096836-project Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.116502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'b908667b-9eab-4249-b81a-acd8c6e40e86'} Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:13.117448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. Jul 04 09:21:13.119062 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:13.120516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] Returning 404 to user: Instance b908667b-9eab-4249-b81a-acd8c6e40e86 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:13.120516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7ed4f7f6-e020-49ad-b68c-d1636bcfbe08 tempest-AttachVolumeTestJSON-2143096836 tempest-AttachVolumeTestJSON-2143096836-project] 10.222.0.26 "GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86" status: 404 len: 111 microversion: 2.1 time: 0.029664 Jul 04 09:21:13.120516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 353/720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:13 2022] GET /compute/v2.1/servers/b908667b-9eab-4249-b81a-acd8c6e40e86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:21:15.274605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-58195033-ab3a-4a37-aa22-1ff3040f2862 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:15.275219 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-58195033-ab3a-4a37-aa22-1ff3040f2862 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:15.281601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58195033-ab3a-4a37-aa22-1ff3040f2862 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:15.282083 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58195033-ab3a-4a37-aa22-1ff3040f2862 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:15.282923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58195033-ab3a-4a37-aa22-1ff3040f2862 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:15.283345 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-58195033-ab3a-4a37-aa22-1ff3040f2862 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:15.308237 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-58195033-ab3a-4a37-aa22-1ff3040f2862 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/ips" status: 200 len: 153 microversion: 2.20 time: 0.037684 Jul 04 09:21:15.308849 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 368/721] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 4 09:21:15 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:21:17.154909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:17.155479 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:17.162545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.162999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.163761 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.164194 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.188040 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lazy-loading 'flavor' on Instance uuid b6adb6fa-7a9a-4413-b937-aecda176cccd {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:17.449404 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d7b69acc-e2c3-4486-9466-948e202b60f0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/action" status: 202 len: 0 microversion: 2.20 time: 0.298952 Jul 04 09:21:17.450046 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 354/722] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 4 09:21:17 2022] POST /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:21:17.464089 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:17.464688 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:17.471646 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.472092 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.472986 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.473453 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.610943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.619185 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.620682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.622168 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a6ad3bd1-6d2d-43c7-b7bf-0a29dd3feff4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.167605 Jul 04 09:21:17.622754 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 369/723] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:17 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:18.647311 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:18.648450 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:18.656755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.657193 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.657981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.658410 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.795941 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.808152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.809920 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.811101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-069aff7d-c161-4ee4-925d-c34968f7793f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.172174 Jul 04 09:21:18.811649 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 355/724] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:18 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:19.057622 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d066ee21-7d26-43f5-b577-28b24b2359bd tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80f57d30>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:19.106073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d066ee21-7d26-43f5-b577-28b24b2359bd tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2c2e9fd5-e671-4b18-9375-03df27e5014b" status: 200 len: 350 microversion: 2.1 time: 0.052262 Jul 04 09:21:19.106636 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 370/725] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:21:19 2022] GET /compute/v2.1/os-volumes/2c2e9fd5-e671-4b18-9375-03df27e5014b => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:19.829794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:19.830389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:19.837310 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:19.837755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:19.838561 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:19.838983 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:19.982841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:19.991708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:19.993203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:19.994470 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f54dc3c-40b9-40bd-87c1-1a58180306e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.168823 Jul 04 09:21:19.995061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 356/726] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:19 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:20.438745 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6c585376-1197-40ab-b50c-0dabf22fcda4 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80f43b80>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:20.485547 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6c585376-1197-40ab-b50c-0dabf22fcda4 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f92ecba2-0a1a-4152-b36e-c55f43ec8da9" status: 200 len: 351 microversion: 2.1 time: 0.051268 Jul 04 09:21:20.486146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 371/727] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:21:20 2022] GET /compute/v2.1/os-volumes/f92ecba2-0a1a-4152-b36e-c55f43ec8da9 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:21.021842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.022850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:21.031966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.032407 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.033185 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.033612 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.172071 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.180098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.181613 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.182818 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c523a8f6-0387-47bb-b967-fb710527409a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.169093 Jul 04 09:21:21.183383 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 357/728] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:21.833106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b27679d8-2737-4cee-a1c1-125b3c6af1c3 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80f804c0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.884039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b27679d8-2737-4cee-a1c1-125b3c6af1c3 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c7f2555b-5fe3-49a6-9d21-33ccae85d7ba" status: 200 len: 350 microversion: 2.1 time: 0.055382 Jul 04 09:21:21.884845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 372/729] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/os-volumes/c7f2555b-5fe3-49a6-9d21-33ccae85d7ba => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:21.897836 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-65f56808-9b83-419d-80db-d9d36a03010c tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80da65e0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.983789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-65f56808-9b83-419d-80db-d9d36a03010c tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089593 Jul 04 09:21:21.984362 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 358/730] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:21.996696 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2b7cedec-6471-4e5c-9a9b-4f9d5ac4f393 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80f04670>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.086076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2b7cedec-6471-4e5c-9a9b-4f9d5ac4f393 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093101 Jul 04 09:21:22.086663 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 373/731] 10.222.0.26 () {58 vars in 1148 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:22.099384 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6d79d364-2b39-4a56-b48b-3de199c9c4dc tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e811ec5e0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.181325 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6d79d364-2b39-4a56-b48b-3de199c9c4dc tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086366 Jul 04 09:21:22.181913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 359/732] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:22.193555 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5c610216-3fef-4e8a-8386-4caeff312d26 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80effee0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.200473 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.201168 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:22.208735 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.209248 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.210107 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.210542 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.274447 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5c610216-3fef-4e8a-8386-4caeff312d26 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084752 Jul 04 09:21:22.275292 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 374/733] 10.222.0.26 () {58 vars in 1166 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:21:22.287204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1f4fde94-31eb-4b43-a732-62737f4cb408 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e810549d0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.345290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.353476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.355017 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.356216 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e3716fa7-2cd5-4add-9070-2a997a1ae872 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.159668 Jul 04 09:21:22.356753 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 360/734] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:22.374362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1f4fde94-31eb-4b43-a732-62737f4cb408 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090682 Jul 04 09:21:22.375122 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 375/735] 10.222.0.26 () {58 vars in 1169 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:21:22.386919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e3baafea-2cfa-4a59-ac5e-ea1d6996e0ca tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80da6310>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.466336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e3baafea-2cfa-4a59-ac5e-ea1d6996e0ca tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083102 Jul 04 09:21:22.467117 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 361/736] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:22.481758 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fd98ed64-5757-4ffc-b334-292576511596 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80f57af0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.570894 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fd98ed64-5757-4ffc-b334-292576511596 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095208 Jul 04 09:21:22.571469 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 376/737] 10.222.0.26 () {58 vars in 1187 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:22.583545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-602699a7-bc22-4625-9bbe-4b09ac155a97 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] Calling method '.version_select at 0x7f8e80da5b80>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.666712 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-602699a7-bc22-4625-9bbe-4b09ac155a97 tempest-VolumesTestJSON-1666105421 tempest-VolumesTestJSON-1666105421-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086987 Jul 04 09:21:22.667298 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 362/738] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:23.379971 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:23.381015 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:23.390515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.390961 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.391724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.392480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.529682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.538333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.539863 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.541028 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bf1c7ed1-c0c6-45d3-b314-b78a535154f3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.168586 Jul 04 09:21:23.541623 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 377/739] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:23 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:24.563617 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:24.564218 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:24.571695 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.572138 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.572891 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.573319 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.708499 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.716753 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.718701 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.719868 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cf25f236-a0d6-43c8-ac80-ae39fbd145b7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.162943 Jul 04 09:21:24.720436 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 363/740] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:24 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:25.743377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:25.744352 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:25.755580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:25.756325 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:25.757593 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:25.758375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:25.896480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:25.908050 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:25.910227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:25.912245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7f4fc456-4f08-4cf8-a022-0f6482c92929 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.175490 Jul 04 09:21:25.912993 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 378/741] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:25 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:26.932817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:26.933623 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:26.940524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.941054 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.941904 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.942430 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.077178 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.087605 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.089266 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.090666 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-051bf19e-e8be-491b-a3c9-f754aa2e9f4b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.161789 Jul 04 09:21:27.091272 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 364/742] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:26 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:28.108653 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:28.109247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:28.111681 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:28.117236 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:28.117694 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:28.118518 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:28.118941 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:28.255145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.263037 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.264532 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.265689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e77a6e44-46c0-437f-a6e7-4ba0829ac37d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1746 microversion: 2.20 time: 0.160994 Jul 04 09:21:28.266281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 379/743] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:28 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:29.288834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:29.289758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:29.300076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.300522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.301281 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.301939 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.320971 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:29.435260 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.443739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.445230 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.446393 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a158ab43-5368-4421-a36b-77da2990b103 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1746 microversion: 2.20 time: 0.164126 Jul 04 09:21:29.446917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 365/744] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:29 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:30.464682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:30.465173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:30.472164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:30.472613 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:30.473480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:30.473916 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:30.607754 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:30.615841 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:30.617444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:30.618764 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d0a48f94-fc09-4050-9b13-863e0ad9489b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.158045 Jul 04 09:21:30.619341 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 380/745] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:30 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:31.493387 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-d02fd67d-a9ad-4bca-97ab-be00fdb6d9c7 req-544d9946-2bda-45a8-b14d-c532595f2fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6adb6fa-7a9a-4413-b937-aecda176cccd", "name": "network-vif-plugged", "status": "completed", "tag": "17a3b35a-43ba-4047-9cb2-8075dbd8e1e7"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:31.503862 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d02fd67d-a9ad-4bca-97ab-be00fdb6d9c7 req-544d9946-2bda-45a8-b14d-c532595f2fd5 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:31.504904 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d02fd67d-a9ad-4bca-97ab-be00fdb6d9c7 req-544d9946-2bda-45a8-b14d-c532595f2fd5 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:31.519289 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-d02fd67d-a9ad-4bca-97ab-be00fdb6d9c7 req-544d9946-2bda-45a8-b14d-c532595f2fd5 service nova] Creating event network-vif-plugged:17a3b35a-43ba-4047-9cb2-8075dbd8e1e7 for instance b6adb6fa-7a9a-4413-b937-aecda176cccd on hv-cinder-81914 Jul 04 09:21:31.525006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-d02fd67d-a9ad-4bca-97ab-be00fdb6d9c7 req-544d9946-2bda-45a8-b14d-c532595f2fd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037259 Jul 04 09:21:31.526402 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 366/746] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:31.637063 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:31.637837 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:31.650947 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:31.651565 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:31.652459 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:31.652994 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:31.806455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.816926 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.819859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.821155 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5928ea38-71a9-45a1-aa3c-99452f29fafd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.188264 Jul 04 09:21:31.821901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 381/747] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:31 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:32.841298 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:32.842176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:32.854374 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.855185 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:32.855670 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.856046 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:33.071753 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:33.080754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:33.082469 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:33.083703 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-71dcc3d3-8425-499d-86c7-0c82172110fe tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.246865 Jul 04 09:21:33.084266 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 367/748] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:32 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:34.104861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:34.105927 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:34.113569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.114048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.114801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.115456 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.291669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:34.304495 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:34.306006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:34.308013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bd08bc74-5b20-42fb-8e19-dae44d0ab5f7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.209427 Jul 04 09:21:34.330063 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 382/749] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:34 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:35.342346 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:35.343728 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:35.352957 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:35.353809 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:35.354790 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:35.355392 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:35.523031 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:35.532376 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:35.533954 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:35.535335 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2535c0a6-fdb3-47af-8722-5fbc3d445d45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.197526 Jul 04 09:21:35.536919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 368/750] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:35 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:36.555071 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:36.555637 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:36.569804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.574902 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.577067 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.578919 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.583810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=71 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:36.776901 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.794260 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.796060 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.797586 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-27abe2b2-50b1-4097-9a55-f7b53c48f1ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.246824 Jul 04 09:21:36.798407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 383/751] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:36 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:37.817526 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:37.818205 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:37.820887 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=38 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:37.828600 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.829397 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:37.830225 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.830978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:38.055622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:38.075743 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:38.079529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:38.081377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-00898b45-8735-440d-a29c-82e00d549841 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.267751 Jul 04 09:21:38.082611 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 369/752] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:37 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:39.099848 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:39.100975 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:39.107597 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:39.108046 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:39.108821 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:39.109252 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:39.340778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:39.352211 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:39.354421 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:39.355990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5da0e6bb-cb07-4475-8778-f0bda8909300 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.260630 Jul 04 09:21:39.357413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 384/753] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:39 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:40.376185 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:40.376829 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:40.384137 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:40.384751 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:40.385580 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:40.385981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:40.868770 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:40.877085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:40.878841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:40.880108 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8799d820-3db7-420d-8e62-d72dcc367555 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1741 microversion: 2.20 time: 0.508222 Jul 04 09:21:40.880568 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 370/754] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:40 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1741 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:41.898804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:41.899506 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:41.906241 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:41.906765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:41.907605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:41.908057 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:42.044555 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:42.052686 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:42.054233 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:42.055394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-96948399-760b-45d1-8eac-691e0dc83da1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1723 microversion: 2.20 time: 0.160591 Jul 04 09:21:42.055955 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 385/755] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:41 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:43.076234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:43.077014 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:43.086127 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:43.086616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:43.087416 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:43.087865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:43.263560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:43.273450 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:43.275644 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:43.277948 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b9e8ecd1-f178-461d-8706-3a178b4a79c2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1723 microversion: 2.20 time: 0.205492 Jul 04 09:21:43.279302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 371/756] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:43 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:43.501347 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-1d3c9c38-c410-4567-b352-3489be1541ae req-6b43ff7e-fa74-4708-9995-b65b5ee7e199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6adb6fa-7a9a-4413-b937-aecda176cccd", "name": "network-vif-unplugged", "status": "completed", "tag": "17a3b35a-43ba-4047-9cb2-8075dbd8e1e7"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:43.516320 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1d3c9c38-c410-4567-b352-3489be1541ae req-6b43ff7e-fa74-4708-9995-b65b5ee7e199 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:43.518136 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1d3c9c38-c410-4567-b352-3489be1541ae req-6b43ff7e-fa74-4708-9995-b65b5ee7e199 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:43.549268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-1d3c9c38-c410-4567-b352-3489be1541ae req-6b43ff7e-fa74-4708-9995-b65b5ee7e199 service nova] Creating event network-vif-unplugged:17a3b35a-43ba-4047-9cb2-8075dbd8e1e7 for instance b6adb6fa-7a9a-4413-b937-aecda176cccd on hv-cinder-81914 Jul 04 09:21:43.557624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-1d3c9c38-c410-4567-b352-3489be1541ae req-6b43ff7e-fa74-4708-9995-b65b5ee7e199 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061745 Jul 04 09:21:43.559753 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 386/757] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:44.296645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:44.297247 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:44.305728 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.306195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.307210 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.307826 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.500458 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.507111 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:44.508653 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:44.511715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.513305 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.514607 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c7d9f9e4-9aec-42f3-8f6b-61ccca6e58d4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1666 microversion: 2.20 time: 0.221754 Jul 04 09:21:44.521408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.521922 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.522725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.523159 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.526040 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 372/758] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:44 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1666 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:44.532210 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-20d05aa3-a375-48b3-9f32-3179c70d58d0 req-8c7f2dfb-df9b-4f5b-8005-55dfc3281b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f2244b-757a-430f-aeb4-c6c6a6d94214", "tag": "78c383e3-0712-437b-8c6a-9bd8b90e67f0"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:44.543976 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-20d05aa3-a375-48b3-9f32-3179c70d58d0 req-8c7f2dfb-df9b-4f5b-8005-55dfc3281b46 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.544409 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-20d05aa3-a375-48b3-9f32-3179c70d58d0 req-8c7f2dfb-df9b-4f5b-8005-55dfc3281b46 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.551690 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:21:44.557373 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-20d05aa3-a375-48b3-9f32-3179c70d58d0 req-8c7f2dfb-df9b-4f5b-8005-55dfc3281b46 service nova] Creating event network-changed:78c383e3-0712-437b-8c6a-9bd8b90e67f0 for instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 on hv-cinder-81914 Jul 04 09:21:44.563664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-20d05aa3-a375-48b3-9f32-3179c70d58d0 req-8c7f2dfb-df9b-4f5b-8005-55dfc3281b46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036380 Jul 04 09:21:44.564484 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 373/759] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:44.574840 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a31f42a8-75eb-4db0-962f-00bdf1250cc1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b379a9f9-6ec9-4188-998f-5414d587dd85"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:44.576048 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a31f42a8-75eb-4db0-962f-00bdf1250cc1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:44.595828 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31f42a8-75eb-4db0-962f-00bdf1250cc1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.596586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31f42a8-75eb-4db0-962f-00bdf1250cc1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.597798 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31f42a8-75eb-4db0-962f-00bdf1250cc1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.598300 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31f42a8-75eb-4db0-962f-00bdf1250cc1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.673722 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4c84a2e7-a959-449a-a694-22644694b916 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 204 len: 0 microversion: 2.1 time: 0.170948 Jul 04 09:21:44.674777 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 387/760] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:21:44 2022] DELETE /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:21:44.689272 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:44.690415 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:44.702224 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.703489 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.705361 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.706130 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.913591 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.923572 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1f922f27-ffb4-4e4d-8943-55b47a2db453 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.243556 Jul 04 09:21:44.924513 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 388/761] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:44 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:44.990095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a31f42a8-75eb-4db0-962f-00bdf1250cc1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.420293 Jul 04 09:21:44.996701 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 374/762] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jul 4 09:21:44 2022] POST /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments => generated 188 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:21:45.116385 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0eda6bce-662b-430b-bce6-311cc265e385 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:45.116991 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0eda6bce-662b-430b-bce6-311cc265e385 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:45.123639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0eda6bce-662b-430b-bce6-311cc265e385 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.124357 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0eda6bce-662b-430b-bce6-311cc265e385 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.125217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0eda6bce-662b-430b-bce6-311cc265e385 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.130430 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0eda6bce-662b-430b-bce6-311cc265e385 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.223432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0eda6bce-662b-430b-bce6-311cc265e385 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/action" status: 202 len: 0 microversion: 2.20 time: 0.111127 Jul 04 09:21:45.224208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 389/763] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 4 09:21:45 2022] POST /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:21:45.241042 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:45.241668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:45.253699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.263099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.263948 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.265700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.450399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:45.460551 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:45.462174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:45.474203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2372fc0c-9bd0-4447-bcbf-8e793492e656 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1752 microversion: 2.20 time: 0.243409 Jul 04 09:21:45.475741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 375/764] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:45 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1752 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:45.943022 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:45.943819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:45.950436 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.950946 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.951809 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.952315 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:46.159107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.167315 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e3beed05-1bfb-493f-bb92-9c3d299d8cae tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1568 microversion: 2.1 time: 0.228808 Jul 04 09:21:46.168146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 390/765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:45 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:46.494008 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:46.494722 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:46.510388 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:46.511056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:46.511845 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:46.513149 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:46.673654 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.686131 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.688145 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.689475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1eca24ee-b4e2-4154-a73d-e8f1b1223b1a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1754 microversion: 2.20 time: 0.200258 Jul 04 09:21:46.690161 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 376/766] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:46 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1754 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:47.016335 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-fbcf5a34-2138-4ebd-8613-68119079e39d req-aae74fb3-38cb-4d72-bcc4-8dc8cc5c88dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f2244b-757a-430f-aeb4-c6c6a6d94214", "name": "network-vif-deleted", "tag": "78c383e3-0712-437b-8c6a-9bd8b90e67f0"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:47.026644 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-fbcf5a34-2138-4ebd-8613-68119079e39d req-aae74fb3-38cb-4d72-bcc4-8dc8cc5c88dc service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.027217 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-fbcf5a34-2138-4ebd-8613-68119079e39d req-aae74fb3-38cb-4d72-bcc4-8dc8cc5c88dc service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.038480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-fbcf5a34-2138-4ebd-8613-68119079e39d req-aae74fb3-38cb-4d72-bcc4-8dc8cc5c88dc service nova] Creating event network-vif-deleted:78c383e3-0712-437b-8c6a-9bd8b90e67f0 for instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 on hv-cinder-81914 Jul 04 09:21:47.043792 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-fbcf5a34-2138-4ebd-8613-68119079e39d req-aae74fb3-38cb-4d72-bcc4-8dc8cc5c88dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096190 Jul 04 09:21:47.044391 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 391/767] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:47.185163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:47.185701 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:47.192558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.192999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.193748 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.194225 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.259791 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba79c77fcd54bbcb673a5cba1ed2975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b3e0ba3aa644ddbbee8f56be21ad06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:47.268442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6588440f-8cec-4038-bc71-9003b81b8f88 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 200 len: 1220 microversion: 2.1 time: 0.086787 Jul 04 09:21:47.269025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 377/768] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:47 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:47.710627 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:47.711384 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:47.718194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.718640 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.719409 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.720006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.857194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:47.869743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:47.871216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:47.872532 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4ba9144e-776c-4e76-b1c5-ce7d72a2756b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.167011 Jul 04 09:21:47.872982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 392/769] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:47 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:48.286281 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:48.286901 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] [instance: 67f2244b-757a-430f-aeb4-c6c6a6d94214] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:48.294320 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:48.294806 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:48.295586 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:48.296023 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:48.311217 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] HTTP exception thrown: Instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 could not be found. Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Request method failure captured: Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 HTTP/1.1 Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwq_ZS0Ud3A0pcTSlJ5gODef30JFj0mjHbioSwnYLeu8K76yICgYH2q9i0Dtw6n_jS0UNK7d3MWM3sMF40IC-p31nMBuiTfpC1ALodMptx7AV3kIqhECk00kNUGsB0efLeGnbDGK1rhOERSXoC-oX72S2_h11LqyUdd10vXUuIKjrdHU Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 33b3e0ba3aa644ddbbee8f56be21ad06 Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestShelveInstance-915443881 Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:21:48.312912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33b3e0ba3aa644ddbbee8f56be21ad06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33b3e0ba3aa644ddbbee8f56be21ad06", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33b3e0ba3aa644ddbbee8f56be21ad06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33b3e0ba3aa644ddbbee8f56be21ad06"}]}] Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestShelveInstance-915443881 Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 33b3e0ba3aa644ddbbee8f56be21ad06 Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestShelveInstance-915443881 Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-TestShelveInstance-915443881-project Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 5ba79c77fcd54bbcb673a5cba1ed2975 Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestShelveInstance-915443881-project Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 could not be found. Jul 04 09:21:48.314590 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': '67f2244b-757a-430f-aeb4-c6c6a6d94214'} Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 could not be found. Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:48.315468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 could not be found. Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 could not be found. Jul 04 09:21:48.316830 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:21:48.318041 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Returning 404 to user: Instance 67f2244b-757a-430f-aeb4-c6c6a6d94214 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:48.318041 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d8c65379-99f5-49c0-8071-717a33b5c5cd tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214" status: 404 len: 111 microversion: 2.1 time: 0.032763 Jul 04 09:21:48.318041 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 378/770] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:48 2022] GET /compute/v2.1/servers/67f2244b-757a-430f-aeb4-c6c6a6d94214 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:21:48.487216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c34ba3ed-ac3c-404c-853b-dd661bcc73f1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] Calling method '.version_select at 0x7f8e80f43700>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:48.520504 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c34ba3ed-ac3c-404c-853b-dd661bcc73f1 tempest-TestShelveInstance-915443881 tempest-TestShelveInstance-915443881-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1158946767" status: 202 len: 0 microversion: 2.1 time: 0.037349 Jul 04 09:21:48.521108 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 393/771] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jul 4 09:21:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1158946767 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:21:48.891389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:48.892077 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:48.898760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:48.899284 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:48.900126 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:48.900564 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:49.540258 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:49.553182 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:49.559930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:49.562994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4fad50ab-6f06-4b63-8b96-44b445ac1a4a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.675694 Jul 04 09:21:49.566661 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 379/772] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:48 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:50.589441 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:50.590259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:50.608867 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:50.609249 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:50.610079 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:50.610980 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:50.948268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.957771 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.959761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.961289 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fdbddb78-1f66-4451-a5d8-726744f564ba tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.376207 Jul 04 09:21:50.972592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 394/773] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:50 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:51.982767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:51.983440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:51.998878 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.000253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.003493 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.004715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.238867 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.261202 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.262848 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.264086 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d5db3f4a-f392-4442-92a8-1e123b677244 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.287925 Jul 04 09:21:52.264597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 380/774] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:51 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:53.290883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:53.294012 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:53.303753 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.304402 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.305460 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.306381 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.510702 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:53.531676 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:53.533568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:53.534919 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-cd314b19-09fb-4980-9fbe-f8f3bbf4f1d3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.255980 Jul 04 09:21:53.536361 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 395/775] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:53 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:54.560812 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:54.562068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:54.574581 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.575509 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.577120 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.577742 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.628549 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:54.998850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:55.010704 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:55.012728 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:55.014120 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1e7cb0b0-67ac-4d60-8e0a-6810065e9a45 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.461911 Jul 04 09:21:55.030227 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 381/776] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:54 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:56.039239 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:56.042009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:56.057218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:56.058791 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:56.061026 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:56.064999 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:56.453562 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.463890 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.474577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-82d55344-b2b8-4733-b44f-d0c98c4ef35f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.440983 Jul 04 09:21:56.478350 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 396/777] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:56 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:57.499737 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:57.502114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:57.526451 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.526900 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.527679 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.534370 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.782740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.797045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.799773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.801112 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-78fa33fd-ca84-4506-b75c-4ba44f96cf2f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.307813 Jul 04 09:21:57.803529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 382/778] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:57 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:58.820908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:58.821973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:58.825807 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:58.831890 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.832532 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.833320 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.834388 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.979515 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.989016 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.990555 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.991781 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dd3c480c-7ffc-4165-891b-c760a8a400d9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.175268 Jul 04 09:21:58.992324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 397/779] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:58 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:00.015209 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:00.016162 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:00.026740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:00.027485 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:00.028746 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:00.029459 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:00.176690 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:00.185252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:00.186777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:00.187932 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-87feb203-4cf2-48f8-862c-922499e5a82a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.179840 Jul 04 09:22:00.188472 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 383/780] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:00 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:01.206882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:01.207528 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:01.214509 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:01.214959 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:01.215719 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:01.216153 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:01.346618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.359670 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.362371 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.364098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2687e6d8-e7f6-4e8c-b0bd-baecfd8f2f1c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.161174 Jul 04 09:22:01.364798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 398/781] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:01 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:02.385207 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:02.386024 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:02.395738 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.396338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.397403 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.398018 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.533940 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.542857 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.544359 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.545522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f10b9ab-163d-4af4-b61f-0a36c3f661e5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.165644 Jul 04 09:22:02.546104 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 384/782] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:02 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:03.568621 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:03.569506 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:03.580880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.581621 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.582647 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.583080 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.597755 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:03.724905 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.733536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.735077 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.736225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-97bbf919-0ad3-4965-ae7e-3aaf5b6f1988 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.174339 Jul 04 09:22:03.736750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 399/783] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:03 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:04.759412 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:04.760105 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:04.769755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.770595 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.771533 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.772047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.908349 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:04.917215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:04.918764 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:04.919935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7cb65b27-7540-487d-a4b6-fca449d05599 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.167516 Jul 04 09:22:04.920496 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 385/784] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:04 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:05.942950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:05.943918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:05.955042 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:05.955798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:05.957172 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:05.957872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:06.100372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.109411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.110953 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.112114 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ceabf616-a35e-4bbe-bdde-2debf67a6431 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.176123 Jul 04 09:22:06.112642 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 400/785] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:05 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:07.133401 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:07.134023 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:07.140732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.141169 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.141966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.142360 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.273983 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.282569 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.284069 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.285211 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8e713b72-6232-48e9-9507-588387785def tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.158226 Jul 04 09:22:07.285789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 386/786] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:07 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:08.176082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-e410bab7-f9d0-4235-9b23-b85c4c34b61a req-5f186a4f-8f0c-4de2-8a1f-d880fa50404f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6adb6fa-7a9a-4413-b937-aecda176cccd", "name": "network-vif-plugged", "status": "completed", "tag": "17a3b35a-43ba-4047-9cb2-8075dbd8e1e7"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:08.187860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-e410bab7-f9d0-4235-9b23-b85c4c34b61a req-5f186a4f-8f0c-4de2-8a1f-d880fa50404f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.188433 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-e410bab7-f9d0-4235-9b23-b85c4c34b61a req-5f186a4f-8f0c-4de2-8a1f-d880fa50404f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.201614 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-e410bab7-f9d0-4235-9b23-b85c4c34b61a req-5f186a4f-8f0c-4de2-8a1f-d880fa50404f service nova] Creating event network-vif-plugged:17a3b35a-43ba-4047-9cb2-8075dbd8e1e7 for instance b6adb6fa-7a9a-4413-b937-aecda176cccd on hv-cinder-81914 Jul 04 09:22:08.207948 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-e410bab7-f9d0-4235-9b23-b85c4c34b61a req-5f186a4f-8f0c-4de2-8a1f-d880fa50404f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035272 Jul 04 09:22:08.208898 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 401/787] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:08.309035 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:08.309648 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:08.312256 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=36 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:08.317402 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.317979 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.318826 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.319337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.462413 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.471510 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.473291 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.474487 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-388b44ef-2977-47a8-a7b8-f864a167fed3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.169416 Jul 04 09:22:08.475125 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 387/788] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:08 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:09.494939 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:09.495651 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:09.502798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.503244 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.504007 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.504434 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.644325 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.654785 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.656769 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.658365 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c42630d3-03ec-42c7-b056-883a1404e160 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1810 microversion: 2.20 time: 0.167771 Jul 04 09:22:09.659398 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 402/789] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:09 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:10.677229 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:10.678028 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:10.684925 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.685373 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:10.686214 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.686642 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:10.818916 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:10.827667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:10.829169 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:10.830404 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0d592a27-8d4e-4266-adb6-b4d144ec0cbd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1797 microversion: 2.20 time: 0.157451 Jul 04 09:22:10.830963 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 388/790] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:10 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1797 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:53.027958 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-44cfb163-f793-4172-89c6-96474f75afe2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:53.028579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-44cfb163-f793-4172-89c6-96474f75afe2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:53.030578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=11 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:53.031329 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=17 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:53.037441 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-44cfb163-f793-4172-89c6-96474f75afe2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.037902 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-44cfb163-f793-4172-89c6-96474f75afe2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.038784 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-44cfb163-f793-4172-89c6-96474f75afe2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.039340 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-44cfb163-f793-4172-89c6-96474f75afe2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.070668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-44cfb163-f793-4172-89c6-96474f75afe2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments/b379a9f9-6ec9-4188-998f-5414d587dd85" status: 200 len: 194 microversion: 2.20 time: 0.046575 Jul 04 09:22:53.071221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 403/791] 10.222.0.26 () {60 vars in 1453 bytes} [Mon Jul 4 09:22:53 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments/b379a9f9-6ec9-4188-998f-5414d587dd85 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:22:53.197297 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:53.197858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:53.200082 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:53.200733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=44 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:53.206436 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.206897 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.207673 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.208099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.299504 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lazy-loading 'services' on Instance uuid b6adb6fa-7a9a-4413-b937-aecda176cccd {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:53.382144 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-32409577-8a2b-4cfd-926e-05c2a0b426d7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments/b379a9f9-6ec9-4188-998f-5414d587dd85" status: 202 len: 0 microversion: 2.20 time: 0.189325 Jul 04 09:22:53.382851 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 389/792] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jul 4 09:22:53 2022] DELETE /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments/b379a9f9-6ec9-4188-998f-5414d587dd85 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:22:53.392224 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d01ad49d-5e6a-4d22-931e-e9df13e5c046 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:53.393230 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d01ad49d-5e6a-4d22-931e-e9df13e5c046 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:53.400469 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d01ad49d-5e6a-4d22-931e-e9df13e5c046 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.400998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d01ad49d-5e6a-4d22-931e-e9df13e5c046 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.401872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d01ad49d-5e6a-4d22-931e-e9df13e5c046 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.402303 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d01ad49d-5e6a-4d22-931e-e9df13e5c046 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.433057 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d01ad49d-5e6a-4d22-931e-e9df13e5c046 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045128 Jul 04 09:22:53.433624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 404/793] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 4 09:22:53 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:22:54.446370 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ecf7b78-20e5-4ff0-a79a-ae1dda5ba4c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:54.447466 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9ecf7b78-20e5-4ff0-a79a-ae1dda5ba4c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:54.453995 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ecf7b78-20e5-4ff0-a79a-ae1dda5ba4c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:54.454435 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ecf7b78-20e5-4ff0-a79a-ae1dda5ba4c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:54.455221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ecf7b78-20e5-4ff0-a79a-ae1dda5ba4c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:54.455643 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ecf7b78-20e5-4ff0-a79a-ae1dda5ba4c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:54.484494 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ecf7b78-20e5-4ff0-a79a-ae1dda5ba4c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043375 Jul 04 09:22:54.485054 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 390/794] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 4 09:22:54 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:22:55.499362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0b1ea849-ea32-498f-b77a-8861cf6e1f9a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:55.501169 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0b1ea849-ea32-498f-b77a-8861cf6e1f9a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:55.507992 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0b1ea849-ea32-498f-b77a-8861cf6e1f9a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.508429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0b1ea849-ea32-498f-b77a-8861cf6e1f9a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.509301 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0b1ea849-ea32-498f-b77a-8861cf6e1f9a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.509698 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0b1ea849-ea32-498f-b77a-8861cf6e1f9a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.539195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0b1ea849-ea32-498f-b77a-8861cf6e1f9a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045870 Jul 04 09:22:55.539751 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 405/795] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 4 09:22:55 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:22:56.551862 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-09e0d6c4-97f0-491c-bc4a-cbf11e4671ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:56.552843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-09e0d6c4-97f0-491c-bc4a-cbf11e4671ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:56.560096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09e0d6c4-97f0-491c-bc4a-cbf11e4671ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.560545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09e0d6c4-97f0-491c-bc4a-cbf11e4671ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.561320 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09e0d6c4-97f0-491c-bc4a-cbf11e4671ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.561752 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09e0d6c4-97f0-491c-bc4a-cbf11e4671ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.590993 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-09e0d6c4-97f0-491c-bc4a-cbf11e4671ff tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043354 Jul 04 09:22:56.591555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 391/796] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 4 09:22:56 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:56.648928 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:56.649537 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:56.656385 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.656761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.657523 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.657978 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.658682 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-619284008", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-673347094", "security_groups": [{"name": "tempest-secgroup-smoke-1779143404"}], "block_device_mapping_v2": [{"uuid": "f5627dd3-4f1f-45dc-9986-f99285c4e76d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "956432d6-39cd-4134-be04-9d32af252f5a"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:56.683187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:22:56.768037 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-794c3612-2c5b-4f0b-829b-ee63817c5ce2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 204 len: 0 microversion: 2.20 time: 0.122786 Jul 04 09:22:56.768687 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 406/797] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 4 09:22:56 2022] DELETE /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 09:22:56.780656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:56.781351 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:56.783240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] validate_networks() for [('956432d6-39cd-4134-be04-9d32af252f5a', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:22:56.787656 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.788318 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.789080 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.789536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.989814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:56.998372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:56.999916 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:57.001085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5cfa32d0-6504-459a-8ee4-60f7ae517725 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.227098 Jul 04 09:22:57.001680 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 407/798] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:56 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:57.240852 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:22:57.241271 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:22:57.241739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:22:57.242173 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:22:57.242577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:22:57.252776 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:57.253209 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.254021 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:57.254479 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.271524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for project dc462a5ff5f649cdb9a24f2232855724. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:22:57.275752 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Getting quotas for user f884304cbb764a8ab4927c3ba8db892d and project dc462a5ff5f649cdb9a24f2232855724. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:22:57.340699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:22:57.343961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5627dd3-4f1f-45dc-9986-f99285c4e76d',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:22:57.489684 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-71c250a2-0864-47fa-b339-edb4a8ffd888 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.835108 Jul 04 09:22:57.490302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 392/799] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:22:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 09:22:57.500555 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dbd3db30-028d-4e0e-a858-6547d813f3e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:57.501284 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-dbd3db30-028d-4e0e-a858-6547d813f3e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:57.553286 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dbd3db30-028d-4e0e-a858-6547d813f3e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:57.559910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dbd3db30-028d-4e0e-a858-6547d813f3e8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1093 microversion: 2.1 time: 0.063265 Jul 04 09:22:57.560461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 408/800] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:57 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:58.030365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:58.031506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:58.043955 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.044738 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.046130 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.046890 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.193061 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:58.205507 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:58.207988 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:58.209675 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0cf07ca8-a78c-4fb4-899b-4cced5af49bc tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.188821 Jul 04 09:22:58.210553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 393/801] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:58 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:58.577706 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:58.578379 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:58.585859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.586324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.587127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.587566 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.649048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:58.657236 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-38cfd29c-9f46-4477-b4a6-cf76da6891c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1135 microversion: 2.1 time: 0.083448 Jul 04 09:22:58.657806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 409/802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:58 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1135 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:59.229389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:59.230116 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:59.237158 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.237522 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.238299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.238781 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.388618 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:59.397961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:59.399484 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:59.400827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b60fc7ab-10c8-4e77-ab2d-426d5c4f64f8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 200 len: 1725 microversion: 2.20 time: 0.175775 Jul 04 09:22:59.401570 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 394/803] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:59 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:59.611732 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-1038af8d-0b81-40fc-8298-48c068f82a80 req-78e19479-2ffd-46d5-a9ec-a45c28a5d26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6adb6fa-7a9a-4413-b937-aecda176cccd", "name": "network-vif-deleted", "tag": "17a3b35a-43ba-4047-9cb2-8075dbd8e1e7"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:59.620295 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1038af8d-0b81-40fc-8298-48c068f82a80 req-78e19479-2ffd-46d5-a9ec-a45c28a5d26e service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.620738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-1038af8d-0b81-40fc-8298-48c068f82a80 req-78e19479-2ffd-46d5-a9ec-a45c28a5d26e service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.631971 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-1038af8d-0b81-40fc-8298-48c068f82a80 req-78e19479-2ffd-46d5-a9ec-a45c28a5d26e service nova] Creating event network-vif-deleted:17a3b35a-43ba-4047-9cb2-8075dbd8e1e7 for instance b6adb6fa-7a9a-4413-b937-aecda176cccd on hv-cinder-81914 Jul 04 09:22:59.636947 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-1038af8d-0b81-40fc-8298-48c068f82a80 req-78e19479-2ffd-46d5-a9ec-a45c28a5d26e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028979 Jul 04 09:22:59.637923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 410/804] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:59.675211 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:59.675938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:59.692929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.694101 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.695161 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.695762 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.785847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:59.795512 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1871eda5-bb01-4baf-9d3b-86d0ad02205f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1191 microversion: 2.1 time: 0.124799 Jul 04 09:22:59.806961 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 395/805] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:59 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1191 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:00.421495 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:00.422338 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:00.429698 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.430176 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.431013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.432145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.446990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] HTTP exception thrown: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Request method failure captured: Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd HTTP/1.1 Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrDQMPW0hraw6y6ZUy09LOZKPc_2oOytXZR8GFcR2U7nPvjLYf5PoSdqPY_bQTbgYbtPp8br8KT30KprM372sC_98uzhBeHNZoJUvDJnNKM2b6YrP5_2wBe8cr9bv9pxgEZoE8fMJgQ4r5TFBjhcGHCZXzzi_PkyBgnyxsKfDr5AKfs Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:23:00.449285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4677b4c393ff41a09c922467365e06f0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4677b4c393ff41a09c922467365e06f0"}]}] Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: bcad5b2163e647f386b482731e1de798 Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:23:00.451151 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'b6adb6fa-7a9a-4413-b937-aecda176cccd'} Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:23:00.452283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:23:00.453873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:23:00.455225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Returning 404 to user: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:23:00.455225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-79a6f2fb-0a45-4b24-a808-4a20e43f912d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 404 len: 111 microversion: 2.20 time: 0.035232 Jul 04 09:23:00.455225 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 411/806] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:00 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:23:00.460047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bce0528c-b627-4156-b7f5-cd1064f61c38 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '.version_select at 0x7f8e80da69d0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:00.464054 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bce0528c-b627-4156-b7f5-cd1064f61c38 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [4538e833-5975-4746-a032-434ac5f955a3] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 09:23:00.813368 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:00.814019 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:00.825798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.826372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.827271 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.827784 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.975379 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:00.983371 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f0f0cbaa-a5ae-4b7b-b900-ed6fe23b92c5 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.174165 Jul 04 09:23:00.992616 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 412/807] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:00 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:01.474761 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [None req-bce0528c-b627-4156-b7f5-cd1064f61c38 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [4538e833-5975-4746-a032-434ac5f955a3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 38320. Jul 04 09:23:01.495495 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bce0528c-b627-4156-b7f5-cd1064f61c38 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016757017" status: 204 len: 0 microversion: 2.20 time: 1.039432 Jul 04 09:23:01.496080 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 396/808] 10.222.0.26 () {60 vars in 1261 bytes} [Mon Jul 4 09:23:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016757017 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 04 09:23:01.653019 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-a9874d66-8236-44da-ada7-d7c408106d48 req-9c818708-20b3-49c2-ae0d-92ca79c87bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6beeba-eccd-443d-8955-d96cd13a0c71", "tag": "c470078a-d902-43dd-b55b-f1c2cb71c278"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:01.661579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-a9874d66-8236-44da-ada7-d7c408106d48 req-9c818708-20b3-49c2-ae0d-92ca79c87bbe service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:01.661972 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-a9874d66-8236-44da-ada7-d7c408106d48 req-9c818708-20b3-49c2-ae0d-92ca79c87bbe service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:01.674600 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-a9874d66-8236-44da-ada7-d7c408106d48 req-9c818708-20b3-49c2-ae0d-92ca79c87bbe service nova] Creating event network-changed:c470078a-d902-43dd-b55b-f1c2cb71c278 for instance eb6beeba-eccd-443d-8955-d96cd13a0c71 on hv-cinder-81914 Jul 04 09:23:01.679662 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-a9874d66-8236-44da-ada7-d7c408106d48 req-9c818708-20b3-49c2-ae0d-92ca79c87bbe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030523 Jul 04 09:23:01.680816 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 413/809] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:02.000519 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:02.001401 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:02.008650 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.009359 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:02.010192 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.010623 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:02.223260 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:02.231399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1ab00e35-394c-41a8-8271-d682bb0c8d96 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.234888 Jul 04 09:23:02.231981 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 397/810] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:01 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:02.428026 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f4082a73-61cb-4fe1-9e08-b6f5afa8306c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'create', calling method: .version_select at 0x7f8e80f57a60>, body: {"keypair": {"name": "tempest-keypair-755602077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzKJRiC+1ZrPLLVgsxfsMYbpUYbqFJKKSsieqDHwb/PMKxpro0VAuN3IckJxZW8LbLX8impsk6JulGVM9RSaPtFUAXuARyehHXTdqFJ62EnKVJBqEQ+YaTSq6YZ300TRQ=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:02.442464 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-f4082a73-61cb-4fe1-9e08-b6f5afa8306c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for project 4677b4c393ff41a09c922467365e06f0. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:23:02.446494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-f4082a73-61cb-4fe1-9e08-b6f5afa8306c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for user bcad5b2163e647f386b482731e1de798 and project 4677b4c393ff41a09c922467365e06f0. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:23:02.472221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f4082a73-61cb-4fe1-9e08-b6f5afa8306c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048880 Jul 04 09:23:02.472764 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 414/811] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 4 09:23:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 09:23:03.253169 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:03.253788 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:03.261077 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:03.261520 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:03.262390 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:03.262758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:03.403233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:03.410967 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-98c36cf2-4015-47aa-adf0-368b6307b31d tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.162017 Jul 04 09:23:03.411537 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 398/812] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:03 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:04.138743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-155533534", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "460f8279-d422-4942-bdf8-e5307675ed2c"}], "security_groups": [{"name": "tempest-securitygroup--41017547"}], "key_name": "tempest-keypair-755602077", "user_data": "}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:04.251751 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] validate_networks() for [('460f8279-d422-4942-bdf8-e5307675ed2c', None, None, None, None, None)] {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:23:04.427660 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:04.428282 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:04.435329 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.435671 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.436442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.436875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.648919 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:04.656878 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-13244b34-ce88-46b8-aa20-dbb374ebaf11 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.233099 Jul 04 09:23:04.657459 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 399/813] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:04 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:04.713278 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:23:04.713952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:23:04.714747 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:23:04.715209 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:23:04.715592 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:23:04.727885 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.728566 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.729369 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.729808 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.747159 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for project 4677b4c393ff41a09c922467365e06f0. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:23:04.751681 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Getting quotas for user bcad5b2163e647f386b482731e1de798 and project 4677b4c393ff41a09c922467365e06f0. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:23:04.765495 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:23:04.767933 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:23:04.817000 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5c8437af-6a78-473d-90b0-0693184a600a tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.683355 Jul 04 09:23:04.817639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 415/814] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 4 09:23:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 09:23:04.828088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45e93a4c-896c-413a-aa47-bed04af8adb1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:04.828813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-45e93a4c-896c-413a-aa47-bed04af8adb1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:04.886434 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45e93a4c-896c-413a-aa47-bed04af8adb1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:04.893933 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45e93a4c-896c-413a-aa47-bed04af8adb1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:04.895970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45e93a4c-896c-413a-aa47-bed04af8adb1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:04.897487 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-45e93a4c-896c-413a-aa47-bed04af8adb1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1280 microversion: 2.20 time: 0.073263 Jul 04 09:23:04.898389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 400/815] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:04 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:05.674988 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:05.675622 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:05.683385 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.683826 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.684581 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.685035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.820325 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:05.828377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a4863666-40b0-4b8e-a195-77b15844f92c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.157758 Jul 04 09:23:05.828930 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 416/816] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:05 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:05.917059 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:05.917727 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:05.926653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.927347 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.928496 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.929649 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:06.001823 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:06.014223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:06.019175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:06.021696 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6bf610b6-a820-421e-94ef-9c3c629e6ed7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1350 microversion: 2.20 time: 0.109530 Jul 04 09:23:06.022296 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 401/817] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:05 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:06.844959 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:06.845593 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:06.852756 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:06.853360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:06.854179 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:06.854619 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.000854 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:07.010048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b28d2912-952e-4aaf-9ecb-c75c756c47f8 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.168016 Jul 04 09:23:07.018939 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 417/818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:06 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:07.040930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:07.041520 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:07.048353 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.048804 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.049597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.050095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.196316 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:07.206352 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:07.208982 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:07.210474 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a39ad75e-39dc-4e12-9980-0ac1344f949f tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1404 microversion: 2.20 time: 0.173904 Jul 04 09:23:07.219448 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 402/819] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:07 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:07.253154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-fbbc617e-9b64-49da-ab74-82334dd32761 req-008a8be4-462a-4c5c-8401-d2369006dca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51983c09-0466-4fd8-a316-f260a15f024c", "tag": "d5e5d30f-204c-44dd-ab8d-b656be790f53"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:07.262826 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-fbbc617e-9b64-49da-ab74-82334dd32761 req-008a8be4-462a-4c5c-8401-d2369006dca4 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.263511 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-fbbc617e-9b64-49da-ab74-82334dd32761 req-008a8be4-462a-4c5c-8401-d2369006dca4 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.277644 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-fbbc617e-9b64-49da-ab74-82334dd32761 req-008a8be4-462a-4c5c-8401-d2369006dca4 service nova] Creating event network-changed:d5e5d30f-204c-44dd-ab8d-b656be790f53 for instance 51983c09-0466-4fd8-a316-f260a15f024c on hv-cinder-81914 Jul 04 09:23:07.283135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-fbbc617e-9b64-49da-ab74-82334dd32761 req-008a8be4-462a-4c5c-8401-d2369006dca4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033739 Jul 04 09:23:07.287192 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 418/820] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:08.028620 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:08.029223 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:08.031187 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:08.036703 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:08.037147 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:08.037924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:08.038359 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:08.179920 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:08.188088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-250d4f5e-8372-445d-8cee-8037ab759cec tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.163747 Jul 04 09:23:08.188641 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 403/821] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:08 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:08.230739 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:08.231438 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:08.238518 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:08.238975 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:08.239761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:08.240198 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:08.381553 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:08.391741 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:08.393250 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:08.394403 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2f2cae74-7731-415e-b43e-84a241cb19df tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1404 microversion: 2.20 time: 0.169428 Jul 04 09:23:08.394959 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 419/822] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:08 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:09.208682 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:09.209627 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:09.220776 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:09.221575 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:09.222898 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:09.223664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:09.373106 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:09.380866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-83702fc4-fcc9-4d76-8fb3-dac8bf2b5e2e tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.178754 Jul 04 09:23:09.381432 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 404/823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:09 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:09.412809 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:09.413376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:09.420511 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:09.420959 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:09.421721 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:09.422205 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:09.556183 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:09.564514 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:09.566059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:09.567203 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d1fac9d8-c8de-49f3-adcb-0fd8d34d3c59 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1404 microversion: 2.20 time: 0.158446 Jul 04 09:23:09.567738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 420/824] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:09 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:10.398717 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:10.399320 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:10.407855 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:10.408531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:10.409253 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:10.409685 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:10.543984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:10.551760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c4063c4f-2347-4bf2-9085-b6beda2ae787 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.158199 Jul 04 09:23:10.552333 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 405/825] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:10 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:10.584680 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:10.585291 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:10.592683 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:10.593156 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:10.594008 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:10.594459 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:10.729544 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:10.737563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:10.739170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:10.740352 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d8842c2f-c8b5-4b43-9d8c-9a0b321c0798 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1404 microversion: 2.20 time: 0.159693 Jul 04 09:23:10.740974 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 421/826] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:10 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:11.572111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:11.573044 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:11.582808 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:11.583250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:11.584402 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:11.585000 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:11.727489 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:11.738555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-99b9f1d4-57ff-418d-be76-f33735338af7 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.172305 Jul 04 09:23:11.739295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 406/827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:11 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:11.758736 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:11.759521 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:11.766365 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:11.766811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:11.767573 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:11.768057 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:11.920270 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:11.931943 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:11.934276 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:11.935973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1cfd5d35-5a6c-4024-94b7-65a40e3228cd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1404 microversion: 2.20 time: 0.180856 Jul 04 09:23:11.936828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 422/828] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:11 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:12.532765 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-b7f5c3bc-4a00-4fdf-9bda-91408c6033d2 req-1f01af1e-e8f6-41cc-b982-c43399db0edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51983c09-0466-4fd8-a316-f260a15f024c", "name": "network-vif-plugged", "status": "completed", "tag": "d5e5d30f-204c-44dd-ab8d-b656be790f53"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:12.541937 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b7f5c3bc-4a00-4fdf-9bda-91408c6033d2 req-1f01af1e-e8f6-41cc-b982-c43399db0edf service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:12.542335 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b7f5c3bc-4a00-4fdf-9bda-91408c6033d2 req-1f01af1e-e8f6-41cc-b982-c43399db0edf service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:12.555538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-b7f5c3bc-4a00-4fdf-9bda-91408c6033d2 req-1f01af1e-e8f6-41cc-b982-c43399db0edf service nova] Creating event network-vif-plugged:d5e5d30f-204c-44dd-ab8d-b656be790f53 for instance 51983c09-0466-4fd8-a316-f260a15f024c on hv-cinder-81914 Jul 04 09:23:12.560840 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-b7f5c3bc-4a00-4fdf-9bda-91408c6033d2 req-1f01af1e-e8f6-41cc-b982-c43399db0edf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031877 Jul 04 09:23:12.561761 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 407/829] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:12.756780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:12.757628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:12.765727 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:12.766862 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:12.767646 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:12.768081 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:12.773344 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:12.908047 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:12.916499 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-06da94de-4fb8-43d9-8ea7-25b1907c5128 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.163137 Jul 04 09:23:12.917058 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 423/830] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:12 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:12.958581 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:12.959277 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:12.965713 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:12.966190 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:12.966949 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:12.967381 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:12.971464 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:13.105949 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:13.114505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:13.116014 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:13.117135 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-52a57993-98f6-4c79-a58b-7d2733f91076 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1404 microversion: 2.20 time: 0.163258 Jul 04 09:23:13.117703 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 408/831] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:12 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:13.934998 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:13.935590 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:13.942649 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:13.943099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:13.943865 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:13.944297 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:14.082367 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:14.090532 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c48e1764-e995-4dd4-bbd5-cb8b6297fe60 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.159904 Jul 04 09:23:14.091109 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 424/832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:13 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:14.136326 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:14.136929 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:14.144338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:14.144794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:14.145875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:14.146336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:14.286587 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:14.294811 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:14.296355 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:14.297942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8c2c8a18-62c4-40e4-a66e-f58954487347 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1597 microversion: 2.20 time: 0.165944 Jul 04 09:23:14.298883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 409/833] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:14 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:14.321924 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-a83cabe5-dcca-4c01-a393-27722d734fa8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:14.322673 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-a83cabe5-dcca-4c01-a393-27722d734fa8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:14.328869 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a83cabe5-dcca-4c01-a393-27722d734fa8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:14.329315 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a83cabe5-dcca-4c01-a393-27722d734fa8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:14.330107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a83cabe5-dcca-4c01-a393-27722d734fa8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:14.330569 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-a83cabe5-dcca-4c01-a393-27722d734fa8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:14.418445 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-a83cabe5-dcca-4c01-a393-27722d734fa8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100473 Jul 04 09:23:14.419020 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 425/834] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 4 09:23:14 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:23:14.592221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-aa23cc34-0dd8-48eb-a016-d49efbba1a1a req-4b41f253-d584-4ee9-86a7-47a611c23037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6beeba-eccd-443d-8955-d96cd13a0c71", "name": "network-vif-plugged", "status": "completed", "tag": "c470078a-d902-43dd-b55b-f1c2cb71c278"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:14.600296 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-aa23cc34-0dd8-48eb-a016-d49efbba1a1a req-4b41f253-d584-4ee9-86a7-47a611c23037 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:14.600738 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-aa23cc34-0dd8-48eb-a016-d49efbba1a1a req-4b41f253-d584-4ee9-86a7-47a611c23037 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:14.611782 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-aa23cc34-0dd8-48eb-a016-d49efbba1a1a req-4b41f253-d584-4ee9-86a7-47a611c23037 service nova] Creating event network-vif-plugged:c470078a-d902-43dd-b55b-f1c2cb71c278 for instance eb6beeba-eccd-443d-8955-d96cd13a0c71 on hv-cinder-81914 Jul 04 09:23:14.616599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-aa23cc34-0dd8-48eb-a016-d49efbba1a1a req-4b41f253-d584-4ee9-86a7-47a611c23037 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028131 Jul 04 09:23:14.617354 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 410/835] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:15.105204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:15.105984 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=12 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:15.110772 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:15.111403 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:15.118669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:15.119186 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:15.119977 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:15.120404 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:15.258802 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:15.267101 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2d1675cc-baf7-4795-9728-eaea9e9b5912 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1265 microversion: 2.1 time: 0.162679 Jul 04 09:23:15.267648 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 426/836] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:15 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:15.400884 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=8 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:15.405777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-ae80f427-2b5f-44ad-8d5a-774eed38c93b req-acd9c37f-5161-4692-b970-606a95dd53c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51983c09-0466-4fd8-a316-f260a15f024c", "tag": "d5e5d30f-204c-44dd-ab8d-b656be790f53"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:15.414214 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ae80f427-2b5f-44ad-8d5a-774eed38c93b req-acd9c37f-5161-4692-b970-606a95dd53c7 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:15.414648 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ae80f427-2b5f-44ad-8d5a-774eed38c93b req-acd9c37f-5161-4692-b970-606a95dd53c7 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:15.427536 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-ae80f427-2b5f-44ad-8d5a-774eed38c93b req-acd9c37f-5161-4692-b970-606a95dd53c7 service nova] Creating event network-changed:d5e5d30f-204c-44dd-ab8d-b656be790f53 for instance 51983c09-0466-4fd8-a316-f260a15f024c on hv-cinder-81914 Jul 04 09:23:15.432488 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-ae80f427-2b5f-44ad-8d5a-774eed38c93b req-acd9c37f-5161-4692-b970-606a95dd53c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032421 Jul 04 09:23:15.433386 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 411/837] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:16.286845 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:16.288567 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:16.298602 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:16.299255 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:16.300111 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:16.300610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:16.487162 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:16.497437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b681fe51-f3b5-4fec-9970-a88c05ca44db tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1452 microversion: 2.1 time: 0.214746 Jul 04 09:23:16.497437 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 427/838] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:16 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:16.513159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:16.514592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:16.522446 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:16.523217 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:16.524150 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:16.524774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:16.671500 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:16.679373 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-215a9ac3-5db5-46b9-b540-f8eede4e024c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1452 microversion: 2.1 time: 0.170425 Jul 04 09:23:16.680029 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 412/839] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:16 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:18.576637 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-23391c45-9977-4a9a-98a8-01bf30ea52de req-e7445a5e-9879-4860-b69d-eeb68373b1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6beeba-eccd-443d-8955-d96cd13a0c71", "tag": "c470078a-d902-43dd-b55b-f1c2cb71c278"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:18.585324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-23391c45-9977-4a9a-98a8-01bf30ea52de req-e7445a5e-9879-4860-b69d-eeb68373b1ca service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:18.585748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-23391c45-9977-4a9a-98a8-01bf30ea52de req-e7445a5e-9879-4860-b69d-eeb68373b1ca service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:18.597971 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-23391c45-9977-4a9a-98a8-01bf30ea52de req-e7445a5e-9879-4860-b69d-eeb68373b1ca service nova] Creating event network-changed:c470078a-d902-43dd-b55b-f1c2cb71c278 for instance eb6beeba-eccd-443d-8955-d96cd13a0c71 on hv-cinder-81914 Jul 04 09:23:18.603442 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-23391c45-9977-4a9a-98a8-01bf30ea52de req-e7445a5e-9879-4860-b69d-eeb68373b1ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030014 Jul 04 09:23:18.604090 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 428/840] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:51.465778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-36c772be-7365-44b1-8979-c208f6249faf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:51.466817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-36c772be-7365-44b1-8979-c208f6249faf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:51.469218 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:51.470109 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=20 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:51.480018 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36c772be-7365-44b1-8979-c208f6249faf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:51.480610 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36c772be-7365-44b1-8979-c208f6249faf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:51.481659 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36c772be-7365-44b1-8979-c208f6249faf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:51.482305 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-36c772be-7365-44b1-8979-c208f6249faf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:51.508317 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-36c772be-7365-44b1-8979-c208f6249faf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/ips" status: 200 len: 153 microversion: 2.20 time: 0.048213 Jul 04 09:23:51.508868 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 413/841] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 4 09:23:51 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/ips => generated 153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:23:53.940471 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:53.941546 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=28 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:53.948226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:53.949170 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:53.960425 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.960873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.961641 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.962113 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.985631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lazy-loading 'flavor' on Instance uuid 51983c09-0466-4fd8-a316-f260a15f024c {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:23:54.264302 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9f2ec23c-641f-4094-a076-d40df89e04e3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/action" status: 202 len: 0 microversion: 2.20 time: 0.326260 Jul 04 09:23:54.264956 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 429/842] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 4 09:23:53 2022] POST /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:23:54.274657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:54.275486 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:54.282881 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:54.283366 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:54.284238 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:54.285336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:54.424398 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:54.433471 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:54.435003 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:54.436192 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-58598c50-565c-4d3b-9629-07b3b2420350 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.166674 Jul 04 09:23:54.436722 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 414/843] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:54 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:55.456309 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:55.457018 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:55.464176 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:55.464627 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:55.465391 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:55.465829 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:55.599222 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:55.607339 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:55.608843 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:55.610024 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-becb9941-e81b-482b-a6b0-3de39fd1d224 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.158502 Jul 04 09:23:55.610547 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 430/844] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:55 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:56.632886 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:56.633849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:56.645226 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:56.645432 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:56.646227 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:56.646968 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:56.784763 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:56.793489 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:56.795025 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:56.796291 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6a37975c-d495-4806-83bd-2aafaab8afe3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.170249 Jul 04 09:23:56.796842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 415/845] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:56 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:57.815227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:57.815844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:57.822963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:57.823411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:57.824175 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:57.824606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:57.976994 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:57.985055 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:57.986595 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:57.987750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fd90e012-72a3-4b62-9b51-4b9f30244b94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.176466 Jul 04 09:23:57.988308 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 431/846] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:57 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:59.010875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:59.011743 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:59.022657 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:59.023215 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:59.024205 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:59.024639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:59.166171 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:59.174466 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:59.175950 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:59.177210 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-821c6188-9139-4895-87bc-d633feb8df00 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.173391 Jul 04 09:23:59.177760 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 416/847] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:59 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:00.201192 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:00.201784 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:00.208895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:00.209380 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:00.210268 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:00.210696 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:00.343229 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:00.351251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:00.352727 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:00.353868 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d4d5eb65-bffe-4225-a65d-4dbf7383c8f1 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.156663 Jul 04 09:24:00.354445 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 432/848] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:00 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:01.376180 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:01.377149 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:01.389033 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:01.389771 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:01.391076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:01.391796 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:01.524789 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:01.533109 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:01.534637 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:01.535877 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4399f667-6ebe-4cab-ae28-f6e04d115ff0 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.166141 Jul 04 09:24:01.536426 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 417/849] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:01 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:02.568156 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:02.569859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:02.587033 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:02.587770 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:02.589025 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:02.589736 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:02.734984 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:02.743287 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:02.744767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:02.745917 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3d08ae9e-ff71-41fe-8705-df31ef988222 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.187283 Jul 04 09:24:02.746494 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 433/850] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:02 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:03.768015 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:03.769076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:03.780664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:03.781395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:03.782710 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:03.783440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:03.918399 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:03.926974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:03.928452 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:03.929609 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-31be52bc-77c4-4ed4-9524-627d75e6d0c7 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.168435 Jul 04 09:24:03.930206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 418/851] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:03 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:04.951240 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:04.951850 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:04.960891 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:04.961377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:04.962266 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:04.962699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:05.095579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:05.107879 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:05.110238 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:05.111923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-08ff3c46-782e-4497-9029-a7919a6161c4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1743 microversion: 2.20 time: 0.166951 Jul 04 09:24:05.112624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 434/852] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:04 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:06.133813 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:06.134455 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:06.142010 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.142506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.143359 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.143838 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.285355 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:06.294219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:06.295723 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:06.296895 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bc4b4bd9-c417-4f66-8edb-054ebeabb408 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1743 microversion: 2.20 time: 0.168308 Jul 04 09:24:06.297427 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 419/853] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:06 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:07.316361 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:07.317009 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:07.324216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.324674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.325473 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.325944 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.464612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:07.472485 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:07.474392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:07.475551 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-66952205-7d86-4162-b7e4-e443ef253843 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.163747 Jul 04 09:24:07.476112 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 435/854] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:07 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:08.495050 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:08.496358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:08.504274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.504798 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.505925 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.506510 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.669755 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.683941 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.686217 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.688019 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ce2df163-6144-4484-b857-8b79949b2e94 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.197448 Jul 04 09:24:08.689456 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 420/855] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:08 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:08.790829 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-0a7422a8-c10a-4426-beb4-06c72bd57db3 req-8fe4fc73-3f96-4f3f-acf3-2059a5e2987f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51983c09-0466-4fd8-a316-f260a15f024c", "name": "network-vif-plugged", "status": "completed", "tag": "d5e5d30f-204c-44dd-ab8d-b656be790f53"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:08.802365 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-0a7422a8-c10a-4426-beb4-06c72bd57db3 req-8fe4fc73-3f96-4f3f-acf3-2059a5e2987f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.802782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-0a7422a8-c10a-4426-beb4-06c72bd57db3 req-8fe4fc73-3f96-4f3f-acf3-2059a5e2987f service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.815473 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-0a7422a8-c10a-4426-beb4-06c72bd57db3 req-8fe4fc73-3f96-4f3f-acf3-2059a5e2987f service nova] Creating event network-vif-plugged:d5e5d30f-204c-44dd-ab8d-b656be790f53 for instance 51983c09-0466-4fd8-a316-f260a15f024c on hv-cinder-81914 Jul 04 09:24:08.821469 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-0a7422a8-c10a-4426-beb4-06c72bd57db3 req-8fe4fc73-3f96-4f3f-acf3-2059a5e2987f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Jul 04 09:24:08.822743 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 436/856] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:24:09.707565 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:09.708866 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:09.716067 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:09.716520 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:09.717334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:09.717772 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:09.860006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:09.869220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:09.870764 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:09.871943 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1d66abef-3813-4098-8005-951569371ff8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.168489 Jul 04 09:24:09.872694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 421/857] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:09 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:10.891317 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:10.892685 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:10.899895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.900610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:10.901524 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.901972 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:11.060782 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:11.073043 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:11.074847 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:11.076018 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4b893051-b8cc-416e-bd35-24c0a78be7ed tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.189844 Jul 04 09:24:11.076793 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 437/858] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:10 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:12.095069 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:12.095713 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:12.102767 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.103314 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.104175 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.104653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.257625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:12.266671 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:12.268212 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:12.269431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-075c9991-3ac9-4826-8f43-fd86608df2bd tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.178610 Jul 04 09:24:12.270274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 422/859] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:12 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:13.288965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:13.290478 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:13.298358 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.298892 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.299746 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.300352 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.466440 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:13.476157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:13.478145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:13.479407 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-aeb101bc-f1d8-40c5-8f97-49d8adeb66b2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.194468 Jul 04 09:24:13.480927 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 438/860] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:13 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:14.498079 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:14.499377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:14.507150 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:14.507600 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:14.508343 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:14.508759 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:14.652326 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:14.660718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:14.662344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:14.663563 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-122f7ac4-bbde-4aa4-92fa-55171fb73cb5 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.169556 Jul 04 09:24:14.664468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 423/861] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:14 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:15.684665 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:15.685290 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:15.691879 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:15.692376 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:15.698148 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:15.698665 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:15.839059 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:15.850312 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:15.854069 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:15.855457 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1300d59c-0b4d-4744-b974-24f1444814db tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1738 microversion: 2.20 time: 0.174785 Jul 04 09:24:15.856022 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 439/862] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:15 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:16.874457 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:16.875139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:16.882531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.883076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:16.883844 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.884544 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.024891 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:17.033103 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:17.034624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:17.035849 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e8308d31-bed0-4a72-a6a1-cff1f3c3f66b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1720 microversion: 2.20 time: 0.165362 Jul 04 09:24:17.036411 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 424/863] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:16 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:18.054585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:18.055203 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:18.062083 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:18.062530 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:18.063294 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:18.063726 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:18.196455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:18.204890 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:18.206426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:18.207556 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f4818ed7-322d-4c7e-a1aa-512c27227715 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1720 microversion: 2.20 time: 0.157049 Jul 04 09:24:18.208190 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 440/864] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:18 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:19.232026 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:19.232639 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:19.239337 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:19.239877 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:19.240645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:19.241085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:19.375021 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:19.383608 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:19.385107 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:19.386326 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-952dc4d3-0c78-4f61-8d20-0a44d97849c9 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1720 microversion: 2.20 time: 0.158413 Jul 04 09:24:19.386886 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 425/865] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:19 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:20.407741 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:20.408622 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:20.417216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.417718 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.418535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.418970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.558377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:20.567666 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:20.569277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:20.570809 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f29e8703-0c67-46a8-81aa-93cd55b80303 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1663 microversion: 2.20 time: 0.169417 Jul 04 09:24:20.571578 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 441/866] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:20 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:20.592638 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-33e005e9-799c-4a18-b896-6c407bb2c99c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a27e7a2-55b3-42c4-8580-af5930baacf1"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:20.594145 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-33e005e9-799c-4a18-b896-6c407bb2c99c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:20.601732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33e005e9-799c-4a18-b896-6c407bb2c99c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.602208 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33e005e9-799c-4a18-b896-6c407bb2c99c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.602970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33e005e9-799c-4a18-b896-6c407bb2c99c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.603400 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33e005e9-799c-4a18-b896-6c407bb2c99c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.810618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-d12fd9a1-9fe9-414e-8c59-98b2388c97af req-954e6d71-369f-45b9-88f5-9e453aedb01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51983c09-0466-4fd8-a316-f260a15f024c", "name": "network-vif-unplugged", "status": "completed", "tag": "d5e5d30f-204c-44dd-ab8d-b656be790f53"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:20.820278 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-d12fd9a1-9fe9-414e-8c59-98b2388c97af req-954e6d71-369f-45b9-88f5-9e453aedb01d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.820673 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-d12fd9a1-9fe9-414e-8c59-98b2388c97af req-954e6d71-369f-45b9-88f5-9e453aedb01d service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.834339 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.compute.server_external_events [req-d12fd9a1-9fe9-414e-8c59-98b2388c97af req-954e6d71-369f-45b9-88f5-9e453aedb01d service nova] Unable to find a host for instance 51983c09-0466-4fd8-a316-f260a15f024c. Dropping event network-vif-unplugged {{(pid=117795) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 09:24:20.835239 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-d12fd9a1-9fe9-414e-8c59-98b2388c97af req-954e6d71-369f-45b9-88f5-9e453aedb01d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028628 Jul 04 09:24:20.835859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 442/867] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 04 09:24:20.893645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-33e005e9-799c-4a18-b896-6c407bb2c99c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307082 Jul 04 09:24:20.894339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 426/868] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jul 4 09:24:20 2022] POST /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:24:21.016410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-04d3d24b-84a7-4876-920a-a9e88408af89 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:21.017058 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-04d3d24b-84a7-4876-920a-a9e88408af89 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:21.024783 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-04d3d24b-84a7-4876-920a-a9e88408af89 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.025227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-04d3d24b-84a7-4876-920a-a9e88408af89 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.026167 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-04d3d24b-84a7-4876-920a-a9e88408af89 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.026599 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-04d3d24b-84a7-4876-920a-a9e88408af89 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.129263 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:21.311338 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-04d3d24b-84a7-4876-920a-a9e88408af89 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-volume_attachments/4a27e7a2-55b3-42c4-8580-af5930baacf1" status: 202 len: 0 microversion: 2.20 time: 0.299485 Jul 04 09:24:21.312277 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 443/869] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jul 4 09:24:21 2022] DELETE /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-volume_attachments/4a27e7a2-55b3-42c4-8580-af5930baacf1 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:24:21.373339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-71dc557e-b85c-4477-b504-c2ddb0806b4d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:21.373946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71dc557e-b85c-4477-b504-c2ddb0806b4d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:21.380972 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dc557e-b85c-4477-b504-c2ddb0806b4d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.381417 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dc557e-b85c-4477-b504-c2ddb0806b4d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.382219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dc557e-b85c-4477-b504-c2ddb0806b4d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.382653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71dc557e-b85c-4477-b504-c2ddb0806b4d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.386383 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:21.493199 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-71dc557e-b85c-4477-b504-c2ddb0806b4d tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "POST /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/action" status: 202 len: 0 microversion: 2.20 time: 0.123832 Jul 04 09:24:21.493946 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 427/870] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 4 09:24:21 2022] POST /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:24:21.506820 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:21.507517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:21.517541 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.518095 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.519161 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.519731 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.653213 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:21.661255 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:21.662938 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:21.664093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f5b5a80a-f7fd-48e4-a4d9-b24c97e2b589 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1671 microversion: 2.20 time: 0.164091 Jul 04 09:24:21.664649 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 444/871] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:21 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:22.684096 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:22.684732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:22.686742 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=33 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:22.694524 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.694969 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.695769 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.696202 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.834476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:22.845197 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:22.847287 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:22.848641 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fbc4c6a1-e60a-4f92-8d4d-5b04698668b3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.169288 Jul 04 09:24:22.849599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 428/872] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:22 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:23.876709 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:23.878418 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:23.887648 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.888098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:23.888905 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.889335 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:24.040789 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:24.049283 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:24.050805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:24.052266 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5ed9e9e5-6f07-45bb-9d1f-7cd346c53dec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.184855 Jul 04 09:24:24.060691 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 445/873] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:23 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:25.071180 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:25.071761 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:25.078463 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:25.078935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:25.079709 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:25.080138 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:25.219489 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:25.228481 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:25.230182 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:25.231463 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f207e996-35c3-4cb2-a3ec-5799bc78e240 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.164716 Jul 04 09:24:25.239551 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 429/874] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:25 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:26.251951 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:26.252835 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:26.256198 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=35 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:26.261615 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:26.262093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:26.262897 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:26.263323 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:26.411854 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:26.420014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:26.421506 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:26.422684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f1e2a460-ad93-4107-8919-7749c1746679 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.175914 Jul 04 09:24:26.425910 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 446/875] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:26 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:27.441042 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:27.442488 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:27.449470 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:27.449942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:27.450726 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:27.451162 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:27.593334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:27.601834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:27.603445 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:27.604722 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5e2e813a-37e7-40c7-86ee-73e3de99eb36 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.167853 Jul 04 09:24:27.605545 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 430/876] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:27 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:28.623099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:28.623686 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:28.630638 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.631084 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.643023 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.643702 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.783146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:28.791474 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:28.792972 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:28.794164 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f2ce9367-53af-4e57-98ab-28c92baae6ac tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.175016 Jul 04 09:24:28.794734 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 447/877] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:28 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:29.813338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:29.814109 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:29.821588 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.822094 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.822856 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.823284 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.976462 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:29.984606 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:29.986133 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:29.987306 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-52ad8991-b3fe-4a1c-8381-8adfbcfe4649 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.178292 Jul 04 09:24:29.988084 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 431/878] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:29 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:31.006443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:31.007032 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:31.014016 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.014467 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.015266 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.015710 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.154462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:31.163418 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:31.164898 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:31.166081 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-9d6c8862-de3d-4719-89b7-bb7d0d10cf48 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.163656 Jul 04 09:24:31.166628 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 448/879] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:31 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:32.184542 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:32.185121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:32.192119 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.192582 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:32.193558 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.194026 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:32.331342 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:32.339488 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:32.340993 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:32.342189 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fd47533e-0b76-4172-a0f6-6a926400998c tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.161708 Jul 04 09:24:32.342758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 432/880] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:32 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:33.360896 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:33.361527 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:33.368968 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:33.369414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:33.370199 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:33.370618 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:33.504154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:33.516963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:33.519237 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:33.520836 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ec046684-9514-48fd-9cad-e2e84606ccaf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.163749 Jul 04 09:24:33.521388 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 449/881] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:33 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:34.544922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:34.545815 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:34.556909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:34.557659 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:34.558970 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:34.559695 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:34.700841 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:34.708942 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:34.710501 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:34.711683 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9192d60d-6089-4cdd-a1dd-a9f1a1635bf8 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.173476 Jul 04 09:24:34.712237 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 433/882] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:34 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:35.734473 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:35.735333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:35.744678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:35.745120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:35.745907 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:35.746370 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:35.903450 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:35.915067 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:35.917506 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:35.919307 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7390ed0d-05d2-4d62-84e2-1f3d8525b452 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.191590 Jul 04 09:24:35.920228 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 450/883] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:35 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:36.939875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:36.940530 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:36.945314 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-c0f5ce7d-0ce6-484c-8e77-6f973b2583b7 req-8b66d4ab-9534-40ce-9d9e-10dfe64e81ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51983c09-0466-4fd8-a316-f260a15f024c", "name": "network-vif-plugged", "status": "completed", "tag": "d5e5d30f-204c-44dd-ab8d-b656be790f53"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:36.947423 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:36.947878 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:36.948739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:36.949221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:36.954220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c0f5ce7d-0ce6-484c-8e77-6f973b2583b7 req-8b66d4ab-9534-40ce-9d9e-10dfe64e81ce service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:36.954905 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c0f5ce7d-0ce6-484c-8e77-6f973b2583b7 req-8b66d4ab-9534-40ce-9d9e-10dfe64e81ce service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:36.966769 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-c0f5ce7d-0ce6-484c-8e77-6f973b2583b7 req-8b66d4ab-9534-40ce-9d9e-10dfe64e81ce service nova] Creating event network-vif-plugged:d5e5d30f-204c-44dd-ab8d-b656be790f53 for instance 51983c09-0466-4fd8-a316-f260a15f024c on hv-cinder-81914 Jul 04 09:24:36.971993 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-c0f5ce7d-0ce6-484c-8e77-6f973b2583b7 req-8b66d4ab-9534-40ce-9d9e-10dfe64e81ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 Jul 04 09:24:36.972593 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 451/884] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:37.108075 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:37.116784 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:37.118307 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:37.119516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-990f8d72-145c-42d9-86d3-23da791b73e2 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.183840 Jul 04 09:24:37.120078 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 434/885] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:36 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:38.143176 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:38.143908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:38.151253 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:38.151697 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:38.152452 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:38.152876 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:38.290689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:38.302758 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:38.305205 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:38.306950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-732ea4db-c168-4fca-9180-c4c8fc867b39 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.170792 Jul 04 09:24:38.307738 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 452/886] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:38 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:39.327167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:39.327885 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:39.338299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:39.338999 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:39.340266 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:39.341001 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:39.481336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:39.490273 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:39.492653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:39.494076 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a4a1a6fd-4258-4a03-9db4-133d34ff5465 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1729 microversion: 2.20 time: 0.170927 Jul 04 09:24:39.494646 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 435/887] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:39 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:40.516835 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:40.517842 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:40.530160 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.530962 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:40.532228 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.532954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:40.681469 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:40.693761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:40.695226 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:40.696377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-60c3e118-bbf2-4c75-9537-cfdea0e755ec tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1716 microversion: 2.20 time: 0.186347 Jul 04 09:24:40.696967 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 453/888] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:40 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1716 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:50.343032 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:50.343724 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:50.345915 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=15 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:50.346112 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-605791a2-2f40-48fa-a272-6212e649e1a6 req-bd605e9a-c46b-451b-af6b-5492a9667083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6beeba-eccd-443d-8955-d96cd13a0c71", "tag": "c470078a-d902-43dd-b55b-f1c2cb71c278"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:50.346634 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:50.352379 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.353032 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.353740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.354185 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.357918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-605791a2-2f40-48fa-a272-6212e649e1a6 req-bd605e9a-c46b-451b-af6b-5492a9667083 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.357918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-605791a2-2f40-48fa-a272-6212e649e1a6 req-bd605e9a-c46b-451b-af6b-5492a9667083 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.368725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-605791a2-2f40-48fa-a272-6212e649e1a6 req-bd605e9a-c46b-451b-af6b-5492a9667083 service nova] Creating event network-changed:c470078a-d902-43dd-b55b-f1c2cb71c278 for instance eb6beeba-eccd-443d-8955-d96cd13a0c71 on hv-cinder-81914 Jul 04 09:24:50.375070 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-605791a2-2f40-48fa-a272-6212e649e1a6 req-bd605e9a-c46b-451b-af6b-5492a9667083 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033145 Jul 04 09:24:50.376355 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 454/889] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:50.390338 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:24:50.480599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-603e26d5-d8dc-41aa-b49a-c5c440f4d8e9 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 204 len: 0 microversion: 2.1 time: 0.141261 Jul 04 09:24:50.481909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 436/890] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:24:50 2022] DELETE /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:24:50.492465 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:50.493485 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:50.500940 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.501488 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.502387 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.502885 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.745016 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:50.752801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-09c94806-b287-438e-9953-a4d76f0ffbab tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1577 microversion: 2.1 time: 0.265516 Jul 04 09:24:50.753410 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 455/891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:50 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1577 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:51.770986 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:51.771731 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:51.779323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:51.780151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:51.780883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:51.781459 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:51.968936 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:51.979574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d3ed7ce7-5445-4539-9a62-af296e058ad1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1577 microversion: 2.1 time: 0.212800 Jul 04 09:24:51.980151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 437/892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:51 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:52.919801 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-dab74b9c-9008-416b-948e-1ed64deca70c req-def20d12-3dcb-4292-8e44-e39f23b0d079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6beeba-eccd-443d-8955-d96cd13a0c71", "name": "network-vif-deleted", "tag": "c470078a-d902-43dd-b55b-f1c2cb71c278"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:52.931544 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-dab74b9c-9008-416b-948e-1ed64deca70c req-def20d12-3dcb-4292-8e44-e39f23b0d079 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:52.931989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-dab74b9c-9008-416b-948e-1ed64deca70c req-def20d12-3dcb-4292-8e44-e39f23b0d079 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:52.934750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=69 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:52.945924 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-dab74b9c-9008-416b-948e-1ed64deca70c req-def20d12-3dcb-4292-8e44-e39f23b0d079 service nova] Creating event network-vif-deleted:c470078a-d902-43dd-b55b-f1c2cb71c278 for instance eb6beeba-eccd-443d-8955-d96cd13a0c71 on hv-cinder-81914 Jul 04 09:24:52.951995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-dab74b9c-9008-416b-948e-1ed64deca70c req-def20d12-3dcb-4292-8e44-e39f23b0d079 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036068 Jul 04 09:24:52.952619 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 456/893] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:52.997271 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:52.997826 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:53.004801 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:53.005247 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:53.006044 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:53.006475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:53.073152 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:53.081641 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-517cf22b-c2e7-4115-9d0a-b38d26a1d49f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 200 len: 1224 microversion: 2.1 time: 0.088359 Jul 04 09:24:53.082285 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 438/894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:52 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:54.105216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:54.105986 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: eb6beeba-eccd-443d-8955-d96cd13a0c71] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:54.114259 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:54.114779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:54.115625 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:54.116099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:54.131992 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] HTTP exception thrown: Instance eb6beeba-eccd-443d-8955-d96cd13a0c71 could not be found. Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Request method failure captured: Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 HTTP/1.1 Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrAkoWWc056TIRHLrlx_PSvDGUZGwshxb7PxoBovvSj8jpJwsis-vHHAITWeTxRmVib72xBBKk1GVSDTLDQvV6Sox2PkffZj1kJV5d_WaQsqTkVAkMFkT_JRx8GATCSHVWV8c5Z-etGTqpxfgEV2nkzyxZOAaJQP-iW1l5kFyXLWFEY Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:24:54.134099 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc462a5ff5f649cdb9a24f2232855724", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc462a5ff5f649cdb9a24f2232855724"}]}] Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: f884304cbb764a8ab4927c3ba8db892d Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance eb6beeba-eccd-443d-8955-d96cd13a0c71 could not be found. Jul 04 09:24:54.135610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'eb6beeba-eccd-443d-8955-d96cd13a0c71'} Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6beeba-eccd-443d-8955-d96cd13a0c71 could not be found. Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:24:54.136422 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6beeba-eccd-443d-8955-d96cd13a0c71 could not be found. Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6beeba-eccd-443d-8955-d96cd13a0c71 could not be found. Jul 04 09:24:54.137970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:24:54.139475 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Returning 404 to user: Instance eb6beeba-eccd-443d-8955-d96cd13a0c71 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:24:54.139475 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e1403763-4b3d-4ed8-a2b7-42b656bbc280 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71" status: 404 len: 111 microversion: 2.1 time: 0.038177 Jul 04 09:24:54.139475 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 457/895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:54 2022] GET /compute/v2.1/servers/eb6beeba-eccd-443d-8955-d96cd13a0c71 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:24:57.218499 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:57.219071 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:57.221196 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-8a91036f-9d33-42c0-943d-e3a114af6fbc req-b6228da7-6179-40af-a7a4-d7d14360ddee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bd7f0c-e581-405e-b37f-58634f0d1286", "tag": "d16716ae-e351-4c48-88e0-7c8705d47ca0"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:57.225362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=24 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:57.226389 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.227379 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.228319 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.228751 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.232154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-8a91036f-9d33-42c0-943d-e3a114af6fbc req-b6228da7-6179-40af-a7a4-d7d14360ddee service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.232601 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-8a91036f-9d33-42c0-943d-e3a114af6fbc req-b6228da7-6179-40af-a7a4-d7d14360ddee service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.245107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-8a91036f-9d33-42c0-943d-e3a114af6fbc req-b6228da7-6179-40af-a7a4-d7d14360ddee service nova] Creating event network-changed:d16716ae-e351-4c48-88e0-7c8705d47ca0 for instance 91bd7f0c-e581-405e-b37f-58634f0d1286 on hv-cinder-81914 Jul 04 09:24:57.250696 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-8a91036f-9d33-42c0-943d-e3a114af6fbc req-b6228da7-6179-40af-a7a4-d7d14360ddee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033527 Jul 04 09:24:57.251629 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 458/896] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:57.260568 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:24:57.345773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-542302a9-b5a3-4c97-986b-045ed86ecf43 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "DELETE /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 204 len: 0 microversion: 2.1 time: 0.131402 Jul 04 09:24:57.346745 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 439/897] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:24:57 2022] DELETE /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:24:57.357006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:57.358098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:57.364665 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.365337 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.366303 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.366908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.516564 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:57.524884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8870be2e-98e4-4509-ac2b-caf4bed0030b tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1578 microversion: 2.1 time: 0.172907 Jul 04 09:24:57.525471 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 459/898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:57 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:58.544774 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:58.545526 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:58.552555 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:58.553184 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:58.553994 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:58.554428 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:58.738454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:58.746464 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1c48f67c-d78d-440c-8abf-f78c8c308513 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1578 microversion: 2.1 time: 0.206805 Jul 04 09:24:58.747086 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 440/899] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:58 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:59.667219 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-80da8b1d-8708-4594-a1b8-1f373ff30665 req-8a002150-462c-4090-b519-3d5b7cf3b241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bd7f0c-e581-405e-b37f-58634f0d1286", "name": "network-vif-deleted", "tag": "d16716ae-e351-4c48-88e0-7c8705d47ca0"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:59.677527 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-80da8b1d-8708-4594-a1b8-1f373ff30665 req-8a002150-462c-4090-b519-3d5b7cf3b241 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:59.678593 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-80da8b1d-8708-4594-a1b8-1f373ff30665 req-8a002150-462c-4090-b519-3d5b7cf3b241 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:59.690972 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-80da8b1d-8708-4594-a1b8-1f373ff30665 req-8a002150-462c-4090-b519-3d5b7cf3b241 service nova] Creating event network-vif-deleted:d16716ae-e351-4c48-88e0-7c8705d47ca0 for instance 91bd7f0c-e581-405e-b37f-58634f0d1286 on hv-cinder-81914 Jul 04 09:24:59.697118 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-80da8b1d-8708-4594-a1b8-1f373ff30665 req-8a002150-462c-4090-b519-3d5b7cf3b241 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Jul 04 09:24:59.697714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 460/900] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:59.764019 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:59.764625 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:59.771949 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:59.772395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:59.773176 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:59.773993 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:59.840796 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f884304cbb764a8ab4927c3ba8db892d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc462a5ff5f649cdb9a24f2232855724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:59.848739 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-48423596-d107-453f-997e-8572854a8e73 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 200 len: 1224 microversion: 2.1 time: 0.088717 Jul 04 09:24:59.849382 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 441/901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:59 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:00.868463 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:00.869344 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 91bd7f0c-e581-405e-b37f-58634f0d1286] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:00.877605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:00.878100 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:00.879341 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:00.879769 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:00.899575 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] HTTP exception thrown: Instance 91bd7f0c-e581-405e-b37f-58634f0d1286 could not be found. Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Request method failure captured: Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 HTTP/1.1 Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrAkoWWc056TIRHLrlx_PSvDGUZGwshxb7PxoBovvSj8jpJwsis-vHHAITWeTxRmVib72xBBKk1GVSDTLDQvV6Sox2PkffZj1kJV5d_WaQsqTkVAkMFkT_JRx8GATCSHVWV8c5Z-etGTqpxfgEV2nkzyxZOAaJQP-iW1l5kFyXLWFEY Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:25:00.901157 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc462a5ff5f649cdb9a24f2232855724", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc462a5ff5f649cdb9a24f2232855724"}]}] Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: f884304cbb764a8ab4927c3ba8db892d Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 91bd7f0c-e581-405e-b37f-58634f0d1286 could not be found. Jul 04 09:25:00.902884 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '91bd7f0c-e581-405e-b37f-58634f0d1286'} Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91bd7f0c-e581-405e-b37f-58634f0d1286 could not be found. Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:00.903814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91bd7f0c-e581-405e-b37f-58634f0d1286 could not be found. Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91bd7f0c-e581-405e-b37f-58634f0d1286 could not be found. Jul 04 09:25:00.905194 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:00.906411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Returning 404 to user: Instance 91bd7f0c-e581-405e-b37f-58634f0d1286 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:00.906411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-650fdfc0-f2a3-4b5f-ba37-ebbcdcd45293 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286" status: 404 len: 111 microversion: 2.1 time: 0.039461 Jul 04 09:25:00.906411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 461/902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:00 2022] GET /compute/v2.1/servers/91bd7f0c-e581-405e-b37f-58634f0d1286 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:01.375146 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:01.375704 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:01.382645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.383095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.383872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.384300 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.398272 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] HTTP exception thrown: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Request method failure captured: Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 HTTP/1.1 Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrAkoWWc056TIRHLrlx_PSvDGUZGwshxb7PxoBovvSj8jpJwsis-vHHAITWeTxRmVib72xBBKk1GVSDTLDQvV6Sox2PkffZj1kJV5d_WaQsqTkVAkMFkT_JRx8GATCSHVWV8c5Z-etGTqpxfgEV2nkzyxZOAaJQP-iW1l5kFyXLWFEY Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:25:01.400323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc462a5ff5f649cdb9a24f2232855724", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc462a5ff5f649cdb9a24f2232855724"}]}] Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: f884304cbb764a8ab4927c3ba8db892d Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.401945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': '4a4c41fd-607b-4420-9719-5e0b6a2f47f2'} Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:01.402847 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.404603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.406395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Returning 404 to user: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:01.406395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a04de0a7-b43b-44bb-a70e-d340df3a5e8c tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 404 len: 111 microversion: 2.1 time: 0.031998 Jul 04 09:25:01.406395 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 442/903] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:01 2022] DELETE /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:01.410958 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:01.411574 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] [instance: 4a4c41fd-607b-4420-9719-5e0b6a2f47f2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:01.417866 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.418353 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.419090 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.419543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.433714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] HTTP exception thrown: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Request method failure captured: Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 HTTP/1.1 Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrAkoWWc056TIRHLrlx_PSvDGUZGwshxb7PxoBovvSj8jpJwsis-vHHAITWeTxRmVib72xBBKk1GVSDTLDQvV6Sox2PkffZj1kJV5d_WaQsqTkVAkMFkT_JRx8GATCSHVWV8c5Z-etGTqpxfgEV2nkzyxZOAaJQP-iW1l5kFyXLWFEY Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:25:01.435405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc462a5ff5f649cdb9a24f2232855724", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc462a5ff5f649cdb9a24f2232855724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc462a5ff5f649cdb9a24f2232855724"}]}] Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: dc462a5ff5f649cdb9a24f2232855724 Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-TestVolumeBootPattern-1124481181 Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: f884304cbb764a8ab4927c3ba8db892d Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-TestVolumeBootPattern-1124481181-project Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.437010 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '4a4c41fd-607b-4420-9719-5e0b6a2f47f2'} Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:01.437819 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. Jul 04 09:25:01.439098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:01.440212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Returning 404 to user: Instance 4a4c41fd-607b-4420-9719-5e0b6a2f47f2 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:01.440212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-991e6049-52b6-4ee6-be22-f98ab115ff3f tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2" status: 404 len: 111 microversion: 2.1 time: 0.030023 Jul 04 09:25:01.440212 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 462/904] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:01 2022] GET /compute/v2.1/servers/4a4c41fd-607b-4420-9719-5e0b6a2f47f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:02.753616 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3afab6b0-1940-4f96-ad7d-37e8b31553d1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] Calling method '.version_select at 0x7f8e80ec1310>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:02.780170 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3afab6b0-1940-4f96-ad7d-37e8b31553d1 tempest-TestVolumeBootPattern-1124481181 tempest-TestVolumeBootPattern-1124481181-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673347094" status: 202 len: 0 microversion: 2.1 time: 0.030662 Jul 04 09:25:02.781042 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 443/905] 10.222.0.26 () {58 vars in 1259 bytes} [Mon Jul 4 09:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673347094 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:25:13.400773 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-abd74ca4-3c1d-4369-89be-17d4e1786d0b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:13.401855 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-abd74ca4-3c1d-4369-89be-17d4e1786d0b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:13.405538 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=9 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:13.406278 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=17 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:13.415187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-abd74ca4-3c1d-4369-89be-17d4e1786d0b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.415678 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-abd74ca4-3c1d-4369-89be-17d4e1786d0b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.416788 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-abd74ca4-3c1d-4369-89be-17d4e1786d0b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.417322 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-abd74ca4-3c1d-4369-89be-17d4e1786d0b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.449432 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-abd74ca4-3c1d-4369-89be-17d4e1786d0b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055558 Jul 04 09:25:13.450015 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 463/906] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 4 09:25:13 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:13.525065 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:13.525597 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:13.530049 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:13.530745 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:13.541249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.541924 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.543085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.543721 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.572811 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:25:13.660943 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cf00ce8c-ed10-4488-a7f1-48a599c56910 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 204 len: 0 microversion: 2.20 time: 0.142883 Jul 04 09:25:13.661559 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 444/907] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 4 09:25:13 2022] DELETE /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 09:25:13.671465 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:13.672143 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:13.679289 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.679740 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.680502 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.680962 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.812580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:13.821162 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:13.822764 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:13.823958 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-fbfe23c0-df37-4be7-a802-45438bf73601 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.157671 Jul 04 09:25:13.824517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 464/908] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:13 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:14.847504 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:14.848561 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:14.859365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.860040 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.861198 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.862055 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:15.003151 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:15.012288 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:15.013850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:15.015211 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c14eb2e3-a1c9-4e17-8e14-165de471e299 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1722 microversion: 2.20 time: 0.174449 Jul 04 09:25:15.015850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 445/909] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:14 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:16.033907 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:16.034932 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:16.042827 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:16.043276 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.044050 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:16.044511 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.076850 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-58dcbab7-e646-4458-8dfe-b850f67cfbfd req-d09d308e-d552-4e62-9619-e137a250fdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51983c09-0466-4fd8-a316-f260a15f024c", "name": "network-vif-deleted", "tag": "d5e5d30f-204c-44dd-ab8d-b656be790f53"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:16.090469 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-58dcbab7-e646-4458-8dfe-b850f67cfbfd req-d09d308e-d552-4e62-9619-e137a250fdcf service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:16.090933 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-58dcbab7-e646-4458-8dfe-b850f67cfbfd req-d09d308e-d552-4e62-9619-e137a250fdcf service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.104752 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-58dcbab7-e646-4458-8dfe-b850f67cfbfd req-d09d308e-d552-4e62-9619-e137a250fdcf service nova] Creating event network-vif-deleted:d5e5d30f-204c-44dd-ab8d-b656be790f53 for instance 51983c09-0466-4fd8-a316-f260a15f024c on hv-cinder-81914 Jul 04 09:25:16.115893 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-58dcbab7-e646-4458-8dfe-b850f67cfbfd req-d09d308e-d552-4e62-9619-e137a250fdcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039202 Jul 04 09:25:16.116623 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 446/910] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:16.143278 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:16.153408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:16.158093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcad5b2163e647f386b482731e1de798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4677b4c393ff41a09c922467365e06f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:16.159174 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2f41d1ab-d34d-4351-b0b4-b79f57cfecdf tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 200 len: 1656 microversion: 2.20 time: 0.129438 Jul 04 09:25:16.159762 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 465/911] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:16 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 1656 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:17.426629 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:17.427353 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:17.434146 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:17.434595 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:17.435363 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:17.435803 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:17.450058 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] HTTP exception thrown: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Request method failure captured: Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c HTTP/1.1 Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrDQMPW0hraw6y6ZUy09LOZKPc_2oOytXZR8GFcR2U7nPvjLYf5PoSdqPY_bQTbgYbtPp8br8KT30KprM372sC_98uzhBeHNZoJUvDJnNKM2b6YrP5_2wBe8cr9bv9pxgEZoE8fMJgQ4r5TFBjhcGHCZXzzi_PkyBgnyxsKfDr5AKfs Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:25:17.451741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4677b4c393ff41a09c922467365e06f0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4677b4c393ff41a09c922467365e06f0"}]}] Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: bcad5b2163e647f386b482731e1de798 Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:17.453460 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': '51983c09-0466-4fd8-a316-f260a15f024c'} Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:17.454984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:17.457195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:17.459589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Returning 404 to user: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:17.459589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-348ffc4e-bc70-4aec-8e01-0cbf6c21b073 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 404 len: 111 microversion: 2.20 time: 0.279815 Jul 04 09:25:17.459589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 447/912] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:17 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 111 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:25:17.468183 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ef9aa7df-46d9-41fc-bc80-1e3fedcd53e4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '.version_select at 0x7f8e80e1e5e0>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:17.490085 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ef9aa7df-46d9-41fc-bc80-1e3fedcd53e4 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755602077" status: 204 len: 0 microversion: 2.20 time: 0.028333 Jul 04 09:25:17.490655 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 466/913] 10.222.0.26 () {60 vars in 1258 bytes} [Mon Jul 4 09:25:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755602077 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 09:25:19.234884 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:19.235406 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:19.242339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.242787 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.243553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.243992 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.257986 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] HTTP exception thrown: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Request method failure captured: Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c HTTP/1.1 Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrDQMPW0hraw6y6ZUy09LOZKPc_2oOytXZR8GFcR2U7nPvjLYf5PoSdqPY_bQTbgYbtPp8br8KT30KprM372sC_98uzhBeHNZoJUvDJnNKM2b6YrP5_2wBe8cr9bv9pxgEZoE8fMJgQ4r5TFBjhcGHCZXzzi_PkyBgnyxsKfDr5AKfs Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:25:19.259532 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4677b4c393ff41a09c922467365e06f0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4677b4c393ff41a09c922467365e06f0"}]}] Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: bcad5b2163e647f386b482731e1de798 Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.261153 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': '51983c09-0466-4fd8-a316-f260a15f024c'} Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:19.262121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.263598 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.265048 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Returning 404 to user: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:19.265048 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4790ecd5-c268-4fed-b8b6-59b5c807d489 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 404 len: 111 microversion: 2.20 time: 0.030034 Jul 04 09:25:19.265048 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 448/914] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 4 09:25:19 2022] DELETE /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:25:19.270015 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:19.270617 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: 51983c09-0466-4fd8-a316-f260a15f024c] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:19.277944 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.278382 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.279139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.279567 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.293040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] HTTP exception thrown: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Request method failure captured: Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c HTTP/1.1 Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrDQMPW0hraw6y6ZUy09LOZKPc_2oOytXZR8GFcR2U7nPvjLYf5PoSdqPY_bQTbgYbtPp8br8KT30KprM372sC_98uzhBeHNZoJUvDJnNKM2b6YrP5_2wBe8cr9bv9pxgEZoE8fMJgQ4r5TFBjhcGHCZXzzi_PkyBgnyxsKfDr5AKfs Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:25:19.294612 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4677b4c393ff41a09c922467365e06f0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4677b4c393ff41a09c922467365e06f0"}]}] Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: bcad5b2163e647f386b482731e1de798 Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.296208 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '51983c09-0466-4fd8-a316-f260a15f024c'} Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:19.297142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. Jul 04 09:25:19.298568 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:19.299849 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Returning 404 to user: Instance 51983c09-0466-4fd8-a316-f260a15f024c could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:19.299849 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5946455d-cf31-4ef7-ac81-47051f36285b tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c" status: 404 len: 111 microversion: 2.20 time: 0.030427 Jul 04 09:25:19.299849 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 467/915] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:19 2022] GET /compute/v2.1/servers/51983c09-0466-4fd8-a316-f260a15f024c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:25:20.442696 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:20.443209 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:20.449490 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.450002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.450773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.451203 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.464827 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] HTTP exception thrown: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Request method failure captured: Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd HTTP/1.1 Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrDQMPW0hraw6y6ZUy09LOZKPc_2oOytXZR8GFcR2U7nPvjLYf5PoSdqPY_bQTbgYbtPp8br8KT30KprM372sC_98uzhBeHNZoJUvDJnNKM2b6YrP5_2wBe8cr9bv9pxgEZoE8fMJgQ4r5TFBjhcGHCZXzzi_PkyBgnyxsKfDr5AKfs Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:25:20.466419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4677b4c393ff41a09c922467365e06f0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4677b4c393ff41a09c922467365e06f0"}]}] Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: bcad5b2163e647f386b482731e1de798 Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.468091 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'b6adb6fa-7a9a-4413-b937-aecda176cccd'} Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:20.469002 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.470573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.472250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Returning 404 to user: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:20.472250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1a2e3d32-21fc-45e7-9b7f-fb615736bba3 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 404 len: 111 microversion: 2.20 time: 0.029210 Jul 04 09:25:20.472250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 449/916] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 4 09:25:20 2022] DELETE /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:25:20.476581 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:20.477234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] [instance: b6adb6fa-7a9a-4413-b937-aecda176cccd] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:20.484088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.484527 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.485276 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.485703 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.499171 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] HTTP exception thrown: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Request method failure captured: Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd HTTP/1.1 Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrDQMPW0hraw6y6ZUy09LOZKPc_2oOytXZR8GFcR2U7nPvjLYf5PoSdqPY_bQTbgYbtPp8br8KT30KprM372sC_98uzhBeHNZoJUvDJnNKM2b6YrP5_2wBe8cr9bv9pxgEZoE8fMJgQ4r5TFBjhcGHCZXzzi_PkyBgnyxsKfDr5AKfs Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:25:20.500682 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4677b4c393ff41a09c922467365e06f0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4677b4c393ff41a09c922467365e06f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4677b4c393ff41a09c922467365e06f0"}]}] Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 4677b4c393ff41a09c922467365e06f0 Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1715123542 Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: bcad5b2163e647f386b482731e1de798 Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1715123542-project Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.502492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'b6adb6fa-7a9a-4413-b937-aecda176cccd'} Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:20.503394 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. Jul 04 09:25:20.504965 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:25:20.506328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] Returning 404 to user: Instance b6adb6fa-7a9a-4413-b937-aecda176cccd could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:20.506328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-899f165d-aece-4a1b-b5c5-4ca55cc3c816 tempest-AttachVolumeShelveTestJSON-1715123542 tempest-AttachVolumeShelveTestJSON-1715123542-project] 10.222.0.26 "GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd" status: 404 len: 111 microversion: 2.20 time: 0.029459 Jul 04 09:25:20.506328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 468/917] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:20 2022] GET /compute/v2.1/servers/b6adb6fa-7a9a-4413-b937-aecda176cccd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 04 09:25:29.142180 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c982f626-b8cd-4dd8-a8d6-b6d5f60a3ef3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: .version_select at 0x7f8e812944c0>, body: {"keypair": {"name": "tempest-keypair-218801307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiEDX3BvkX5rFZams3CIl0Q6N1R2+V9atNcJzF9e6eCnl/yGqj8xqbWO9cNRMbjUMtec040Ow08ECXK7JOyAPkXFnpFbYksi1u8DFi3FBiy8lZroUldNnsITHjPM3VlKQ=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:29.158565 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-c982f626-b8cd-4dd8-a8d6-b6d5f60a3ef3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:25:29.162794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-c982f626-b8cd-4dd8-a8d6-b6d5f60a3ef3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:25:29.187518 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c982f626-b8cd-4dd8-a8d6-b6d5f60a3ef3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172545 Jul 04 09:25:29.188377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 450/918] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:25:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:25:30.475853 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-113985252", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "486e3f33-e162-412f-9da2-b680c8148bb8"}], "security_groups": [{"name": "tempest-securitygroup--440252917"}], "key_name": "tempest-keypair-218801307", "user_data": "}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:30.483260 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:30.496109 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=22 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:30.587090 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] validate_networks() for [('486e3f33-e162-412f-9da2-b680c8148bb8', None, None, None, None, None)] {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:25:31.073270 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:25:31.073970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:25:31.074831 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:25:31.075462 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:25:31.075878 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:25:31.085597 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.086392 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.089218 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.089674 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.111024 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:25:31.115717 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:25:31.130202 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:25:31.132537 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:25:31.218716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5b40d3d1-c7d0-4be9-a6cf-a26b953544ba tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.746752 Jul 04 09:25:31.224001 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 469/919] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:25:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 09:25:31.238067 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-78533586-ed29-43f9-8fb9-d1ea86ea7730 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:31.239171 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-78533586-ed29-43f9-8fb9-d1ea86ea7730 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:31.251053 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:31.386629 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-78533586-ed29-43f9-8fb9-d1ea86ea7730 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:31.396955 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-78533586-ed29-43f9-8fb9-d1ea86ea7730 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1240 microversion: 2.1 time: 0.166189 Jul 04 09:25:31.398193 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 451/920] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:31 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1240 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:32.416576 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:32.417250 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:32.424576 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:32.425031 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:32.425812 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:32.426396 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:32.495025 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:32.503230 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0d0d76b3-527d-473d-9cf2-b277c9b5686b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1292 microversion: 2.1 time: 0.091310 Jul 04 09:25:32.503767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 470/921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:32 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:33.521085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:33.521694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:33.530212 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:33.530702 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:33.532242 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:33.532680 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:33.721811 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:33.729645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6af75295-3d85-473d-96cd-8e53844b3366 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1365 microversion: 2.1 time: 0.212448 Jul 04 09:25:33.730303 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 452/922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:33 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:34.392464 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-c48302af-993e-4a28-88e0-840030adcf22 req-752509da-16f3-496e-9340-ce084624c6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627", "tag": "0489cfc9-3b2b-469b-b7ae-e5083571008d"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:34.402386 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c48302af-993e-4a28-88e0-840030adcf22 req-752509da-16f3-496e-9340-ce084624c6a9 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:34.402923 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-c48302af-993e-4a28-88e0-840030adcf22 req-752509da-16f3-496e-9340-ce084624c6a9 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:34.414473 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-c48302af-993e-4a28-88e0-840030adcf22 req-752509da-16f3-496e-9340-ce084624c6a9 service nova] Creating event network-changed:0489cfc9-3b2b-469b-b7ae-e5083571008d for instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 on hv-cinder-81914 Jul 04 09:25:34.420062 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-c48302af-993e-4a28-88e0-840030adcf22 req-752509da-16f3-496e-9340-ce084624c6a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101062 Jul 04 09:25:34.420677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 471/923] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:34.747442 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:34.748834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:34.755612 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:34.756043 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:34.756801 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:34.757225 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:34.900747 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:34.908668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d1a3f1b2-960d-4993-8d71-ce6e1862fddd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1365 microversion: 2.1 time: 0.165624 Jul 04 09:25:34.909234 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 453/924] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:34 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:35.926405 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:35.927195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:35.933948 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:35.934418 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:35.935209 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:35.935637 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.161262 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:36.169525 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-87742dec-ec59-4fb7-bb93-6e4064829303 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1365 microversion: 2.1 time: 0.248052 Jul 04 09:25:36.170145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 472/925] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:35 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:37.187018 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:37.187604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:37.194732 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:37.195183 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:37.195962 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:37.196396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:37.336310 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:37.346140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e9a8d817-3d5b-4288-b7af-ad516ab88924 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1365 microversion: 2.1 time: 0.163409 Jul 04 09:25:37.346733 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 454/926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:37 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:38.372890 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:38.373750 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:38.384545 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:38.384990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:38.385753 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:38.386286 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:38.533832 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:38.545623 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8d214e81-f38c-4072-a558-8456dc8e0f12 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1365 microversion: 2.1 time: 0.179030 Jul 04 09:25:38.546361 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 473/927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:38 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:39.285190 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-99ac6d84-7187-41d4-8b0b-60d4735c281d req-166a2e27-e636-41de-a467-125d5e330753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627", "name": "network-vif-plugged", "status": "completed", "tag": "0489cfc9-3b2b-469b-b7ae-e5083571008d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:39.294393 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-99ac6d84-7187-41d4-8b0b-60d4735c281d req-166a2e27-e636-41de-a467-125d5e330753 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:39.294857 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-99ac6d84-7187-41d4-8b0b-60d4735c281d req-166a2e27-e636-41de-a467-125d5e330753 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:39.306612 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-99ac6d84-7187-41d4-8b0b-60d4735c281d req-166a2e27-e636-41de-a467-125d5e330753 service nova] Creating event network-vif-plugged:0489cfc9-3b2b-469b-b7ae-e5083571008d for instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 on hv-cinder-81914 Jul 04 09:25:39.311750 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-99ac6d84-7187-41d4-8b0b-60d4735c281d req-166a2e27-e636-41de-a467-125d5e330753 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 Jul 04 09:25:39.312340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 455/928] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:39.567057 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:39.567589 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:39.577499 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:39.578156 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:39.579177 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:39.579605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:39.726989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:39.734739 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-65916f1a-fc60-4f54-a7a8-0d77c3d23803 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1365 microversion: 2.1 time: 0.171817 Jul 04 09:25:39.735309 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 474/929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:39 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:40.757248 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:40.758447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:40.769535 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:40.770336 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:40.771624 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:40.772714 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:40.915290 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:40.926860 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2b67a869-f637-4c84-b245-fcc2137cd418 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1365 microversion: 2.1 time: 0.177290 Jul 04 09:25:40.927693 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 456/930] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:40 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:41.948958 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:41.949799 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:41.952305 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:41.952970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:41.959500 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:41.959949 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:41.960716 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:41.961150 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:42.093563 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:42.103429 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-8e51532b-b342-42d7-8f4c-1db00e44ba87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1556 microversion: 2.1 time: 0.160913 Jul 04 09:25:42.104328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 475/931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:41 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:42.122189 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f7dfef44-fc77-4e38-ad35-ee431bd3879d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:42.122752 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f7dfef44-fc77-4e38-ad35-ee431bd3879d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:42.124679 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:42.131070 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f7dfef44-fc77-4e38-ad35-ee431bd3879d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:42.131505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f7dfef44-fc77-4e38-ad35-ee431bd3879d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:42.132257 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f7dfef44-fc77-4e38-ad35-ee431bd3879d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:42.132700 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f7dfef44-fc77-4e38-ad35-ee431bd3879d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:42.212323 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f7dfef44-fc77-4e38-ad35-ee431bd3879d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095304 Jul 04 09:25:42.213027 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 457/932] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:25:42 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:43.149561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-94cbb25c-f08b-4cc5-ba79-c0d3d78f6fc5 req-f1af56e3-fe57-4c14-80f2-1eedf083dbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627", "tag": "0489cfc9-3b2b-469b-b7ae-e5083571008d"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:43.159770 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-94cbb25c-f08b-4cc5-ba79-c0d3d78f6fc5 req-f1af56e3-fe57-4c14-80f2-1eedf083dbdd service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.160210 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-94cbb25c-f08b-4cc5-ba79-c0d3d78f6fc5 req-f1af56e3-fe57-4c14-80f2-1eedf083dbdd service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.172048 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-94cbb25c-f08b-4cc5-ba79-c0d3d78f6fc5 req-f1af56e3-fe57-4c14-80f2-1eedf083dbdd service nova] Creating event network-changed:0489cfc9-3b2b-469b-b7ae-e5083571008d for instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 on hv-cinder-81914 Jul 04 09:25:43.177200 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-94cbb25c-f08b-4cc5-ba79-c0d3d78f6fc5 req-f1af56e3-fe57-4c14-80f2-1eedf083dbdd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031741 Jul 04 09:25:43.177815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 476/933] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:19.297955 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:19.298842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=30 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:19.303714 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-067097b5-149c-469d-82a2-10250ef8aca6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:19.304210 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-067097b5-149c-469d-82a2-10250ef8aca6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:19.311574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-067097b5-149c-469d-82a2-10250ef8aca6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:19.312026 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-067097b5-149c-469d-82a2-10250ef8aca6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:19.312771 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-067097b5-149c-469d-82a2-10250ef8aca6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:19.313206 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-067097b5-149c-469d-82a2-10250ef8aca6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:19.338111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-067097b5-149c-469d-82a2-10250ef8aca6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/ips" status: 200 len: 151 microversion: 2.1 time: 0.042326 Jul 04 09:26:19.338667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 458/934] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:26:19 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:20.713111 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:20.714074 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=36 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:20.719834 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7c103ec0-ee52-468d-ba38-73281f640a66 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e551d46c-786b-49f6-98df-ae0ad4e52086"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:20.721605 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7c103ec0-ee52-468d-ba38-73281f640a66 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:20.733180 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7c103ec0-ee52-468d-ba38-73281f640a66 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:20.733873 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7c103ec0-ee52-468d-ba38-73281f640a66 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:20.734934 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7c103ec0-ee52-468d-ba38-73281f640a66 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:20.735560 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7c103ec0-ee52-468d-ba38-73281f640a66 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:20.990767 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7c103ec0-ee52-468d-ba38-73281f640a66 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280279 Jul 04 09:26:20.991362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 477/935] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:26:20 2022] POST /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:27.479807 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5e55fc45-5ca4-4dc6-85e4-b0b08a464e1f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: .version_select at 0x7f8e81092940>, body: {"keypair": {"name": "tempest-keypair-2026358023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkd45GiApVF93/BnJwIT+sewowxsxaGHKNRYIgCVrwH0juz+Ri0UAThRd9KVHbJJ1OF068rxnyoim5YWqszjeLBnjDGg9uPY/j7ZDZXrbPGqw5ND2inQlHeNvJMwTOgow=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:27.498715 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-5e55fc45-5ca4-4dc6-85e4-b0b08a464e1f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:26:27.503135 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-5e55fc45-5ca4-4dc6-85e4-b0b08a464e1f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:26:27.528419 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5e55fc45-5ca4-4dc6-85e4-b0b08a464e1f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055390 Jul 04 09:26:27.529035 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 459/936] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:26:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:28.821795 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1693444078", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "486e3f33-e162-412f-9da2-b680c8148bb8"}], "security_groups": [{"name": "tempest-securitygroup--1538551515"}], "key_name": "tempest-keypair-2026358023", "user_data": "}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:28.929862 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.network.neutron [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] validate_networks() for [('486e3f33-e162-412f-9da2-b680c8148bb8', None, None, None, None, None)] {{(pid=117795) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:26:29.320187 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:26:29.320606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image limits 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:26:29.321073 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:26:29.321477 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image pref 0:0:0 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:26:29.321904 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.virt.hardware [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:26:29.331658 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:29.332106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:29.332889 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:29.333316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:29.350366 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:26:29.355152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:26:29.367584 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Going to run 1 instances... {{(pid=117795) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:26:29.369918 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:26:29.424713 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0e95ea6d-6475-4fd3-8c97-5a070d41cd84 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609687 Jul 04 09:26:29.425332 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 478/937] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:26:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:26:29.433139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:29.437430 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-86c61efb-34d1-4cc4-b4b8-6788576c3125 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:29.438079 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-86c61efb-34d1-4cc4-b4b8-6788576c3125 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:29.492252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-86c61efb-34d1-4cc4-b4b8-6788576c3125 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:29.500019 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-86c61efb-34d1-4cc4-b4b8-6788576c3125 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1242 microversion: 2.1 time: 0.068156 Jul 04 09:26:29.500561 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 460/938] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:29 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:30.517360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:30.517940 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:30.524861 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:30.525368 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:30.526175 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:30.526602 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:30.603543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:30.611120 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2941159f-935f-43db-b504-4f69c28450c4 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1312 microversion: 2.1 time: 0.098477 Jul 04 09:26:30.611900 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 479/939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:30 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:31.628149 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:31.628770 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:31.635573 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:31.636016 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:31.636783 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:31.637212 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:31.849340 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:31.857907 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bddec179-6c15-4977-a95c-226825005bde tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1368 microversion: 2.1 time: 0.233528 Jul 04 09:26:31.858475 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 461/940] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:31 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:32.198669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-e1bad5a4-826b-4eb7-8d6a-c3a15512f69e req-71d33f62-e53b-4a67-b327-f2ea05c278bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a75317-e751-4c45-9ec6-3a98521ca1fb", "tag": "37170a3e-0988-4d6b-886d-ac56bca019eb"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:32.223029 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-e1bad5a4-826b-4eb7-8d6a-c3a15512f69e req-71d33f62-e53b-4a67-b327-f2ea05c278bd service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:32.223616 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-e1bad5a4-826b-4eb7-8d6a-c3a15512f69e req-71d33f62-e53b-4a67-b327-f2ea05c278bd service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:32.237539 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-e1bad5a4-826b-4eb7-8d6a-c3a15512f69e req-71d33f62-e53b-4a67-b327-f2ea05c278bd service nova] Creating event network-changed:37170a3e-0988-4d6b-886d-ac56bca019eb for instance d7a75317-e751-4c45-9ec6-3a98521ca1fb on hv-cinder-81914 Jul 04 09:26:32.247245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-e1bad5a4-826b-4eb7-8d6a-c3a15512f69e req-71d33f62-e53b-4a67-b327-f2ea05c278bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051525 Jul 04 09:26:32.248706 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 480/941] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:32.879116 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:32.880059 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:32.887967 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:32.888410 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:32.889174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:32.889604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:33.028959 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:33.036956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-506df986-fb70-4ad0-a85e-a41ee3c81aae tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1368 microversion: 2.1 time: 0.164320 Jul 04 09:26:33.037965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 462/942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:32 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:34.059646 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:34.060266 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:34.067388 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:34.067836 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:34.068604 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:34.069105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:34.212701 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:34.222517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-7f208307-fc31-4495-90df-d7b8a05a9ddf tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1368 microversion: 2.1 time: 0.167238 Jul 04 09:26:34.223089 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 481/943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:34 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:35.249233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:35.250316 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:35.259709 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:35.260150 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:35.260912 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:35.261339 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:35.409508 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:35.418263 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2ab2f180-f72f-4e1e-b13e-815a101e8e01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1368 microversion: 2.1 time: 0.175902 Jul 04 09:26:35.419135 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 463/944] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:35 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:36.437254 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:36.437876 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:36.445227 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:36.445722 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:36.446591 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:36.447052 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:36.583281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:36.591547 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-77df150e-ae59-458b-9c78-5d0e0891b258 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1368 microversion: 2.1 time: 0.159215 Jul 04 09:26:36.592094 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 482/945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:36 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:37.608865 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:37.609493 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:37.617967 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:37.618415 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:37.619427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:37.619840 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:37.665115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-d69c8f18-f74a-47f9-b4d6-450ee16914ea req-cdad96ac-f70b-4db5-acdd-5c95ae1f2a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a75317-e751-4c45-9ec6-3a98521ca1fb", "name": "network-vif-plugged", "status": "completed", "tag": "37170a3e-0988-4d6b-886d-ac56bca019eb"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:37.673666 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d69c8f18-f74a-47f9-b4d6-450ee16914ea req-cdad96ac-f70b-4db5-acdd-5c95ae1f2a1b service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:37.674146 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d69c8f18-f74a-47f9-b4d6-450ee16914ea req-cdad96ac-f70b-4db5-acdd-5c95ae1f2a1b service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:37.685799 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-d69c8f18-f74a-47f9-b4d6-450ee16914ea req-cdad96ac-f70b-4db5-acdd-5c95ae1f2a1b service nova] Creating event network-vif-plugged:37170a3e-0988-4d6b-886d-ac56bca019eb for instance d7a75317-e751-4c45-9ec6-3a98521ca1fb on hv-cinder-81914 Jul 04 09:26:37.690886 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-d69c8f18-f74a-47f9-b4d6-450ee16914ea req-cdad96ac-f70b-4db5-acdd-5c95ae1f2a1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092079 Jul 04 09:26:37.691750 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 464/946] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:37.757811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:37.765838 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3bd80b0c-e442-4a0f-9944-ec787bb955da tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1368 microversion: 2.1 time: 0.161086 Jul 04 09:26:37.766448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 483/947] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:37 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:26:38.784250 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:38.784958 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:38.792156 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:38.792668 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:38.793385 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:38.793816 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:38.931480 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:38.942816 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-44e989af-ae03-43d1-9cc6-7617dbc0a982 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1368 microversion: 2.1 time: 0.162937 Jul 04 09:26:38.943562 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 465/948] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:38 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:39.963362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:39.963982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:39.966412 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:39.967075 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:39.973204 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:39.973645 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:39.974425 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:39.974855 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:40.109792 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:40.117874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5928a5ff-1f01-4712-9324-ce8aa9a03842 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1558 microversion: 2.1 time: 0.160464 Jul 04 09:26:40.118713 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 484/949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:39 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:40.136308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-93feeb85-f8f4-4c70-bde4-46cba68c79d8 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:40.136864 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-93feeb85-f8f4-4c70-bde4-46cba68c79d8 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:40.139873 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:40.148985 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93feeb85-f8f4-4c70-bde4-46cba68c79d8 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:40.149539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93feeb85-f8f4-4c70-bde4-46cba68c79d8 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:40.150519 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93feeb85-f8f4-4c70-bde4-46cba68c79d8 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:40.150964 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93feeb85-f8f4-4c70-bde4-46cba68c79d8 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:40.229311 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-93feeb85-f8f4-4c70-bde4-46cba68c79d8 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098445 Jul 04 09:26:40.229911 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 466/950] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:26:40 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:41.174609 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-a976480e-3090-4388-b987-9b255eae73f2 req-790c063e-231d-47f6-8e98-d0a2ca31e856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a75317-e751-4c45-9ec6-3a98521ca1fb", "tag": "37170a3e-0988-4d6b-886d-ac56bca019eb"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:41.183511 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-a976480e-3090-4388-b987-9b255eae73f2 req-790c063e-231d-47f6-8e98-d0a2ca31e856 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:41.183952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-a976480e-3090-4388-b987-9b255eae73f2 req-790c063e-231d-47f6-8e98-d0a2ca31e856 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:41.194926 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-a976480e-3090-4388-b987-9b255eae73f2 req-790c063e-231d-47f6-8e98-d0a2ca31e856 service nova] Creating event network-changed:37170a3e-0988-4d6b-886d-ac56bca019eb for instance d7a75317-e751-4c45-9ec6-3a98521ca1fb on hv-cinder-81914 Jul 04 09:26:41.200285 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-a976480e-3090-4388-b987-9b255eae73f2 req-790c063e-231d-47f6-8e98-d0a2ca31e856 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029350 Jul 04 09:26:41.200875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 485/951] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:17.442577 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:17.443346 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=30 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:17.449811 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-78adce31-6f2b-462b-8ba2-ae2709552431 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:17.450518 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-78adce31-6f2b-462b-8ba2-ae2709552431 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:17.460870 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78adce31-6f2b-462b-8ba2-ae2709552431 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.461352 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78adce31-6f2b-462b-8ba2-ae2709552431 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:17.462239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78adce31-6f2b-462b-8ba2-ae2709552431 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.462669 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78adce31-6f2b-462b-8ba2-ae2709552431 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:17.487888 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-78adce31-6f2b-462b-8ba2-ae2709552431 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb/ips" status: 200 len: 150 microversion: 2.1 time: 0.047730 Jul 04 09:27:17.488980 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 467/952] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:27:17 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:17.497165 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:17.498664 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:17.503427 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e551d46c-786b-49f6-98df-ae0ad4e52086"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:17.504672 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:17.512481 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.512993 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:17.513699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.514169 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:17.598977 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Invalid volume: volume e551d46c-786b-49f6-98df-ae0ad4e52086 is already attached to instances: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: POST /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb/os-volume_attachments HTTP/1.1 Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 74 Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:27:17.600695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {"volumeAttachment": {"volumeId": "e551d46c-786b-49f6-98df-ae0ad4e52086"}} Jul 04 09:27:17.602461 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Invalid volume: volume e551d46c-786b-49f6-98df-ae0ad4e52086 is already attached to instances: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'server_id': 'd7a75317-e751-4c45-9ec6-3a98521ca1fb', 'body': {'volumeAttachment': {'volumeId': 'e551d46c-786b-49f6-98df-ae0ad4e52086'}}} Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e551d46c-786b-49f6-98df-ae0ad4e52086 is already attached to instances: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:17.603501 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e551d46c-786b-49f6-98df-ae0ad4e52086 is already attached to instances: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:17.605154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e551d46c-786b-49f6-98df-ae0ad4e52086 is already attached to instances: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 400 to user: Invalid volume: volume e551d46c-786b-49f6-98df-ae0ad4e52086 is already attached to instances: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2df4c956-14a6-4f58-afd7-761f99024d75 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106615 Jul 04 09:27:17.606779 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 486/953] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:27:17 2022] POST /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:27:17.610883 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:17.611375 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:17.617568 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.618117 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:17.618905 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.619332 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:17.644795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:27:17.723230 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-855ba6ee-a6f2-40a8-ba9e-beddf28e8db6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 204 len: 0 microversion: 2.1 time: 0.115608 Jul 04 09:27:17.724235 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 468/954] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:27:17 2022] DELETE /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:27:17.732928 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:17.733540 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:17.739991 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.740440 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:17.741201 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:17.741630 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:18.029590 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:18.037590 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6fd3ddd7-6fb5-4e8c-87a2-44d14a7512bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1683 microversion: 2.1 time: 0.308792 Jul 04 09:27:18.038200 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 487/955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:17 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1683 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:19.061632 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:19.062699 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:19.071431 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:19.071875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:19.072667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:19.073095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:19.211476 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:19.219604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7ac33861-1501-459e-bc08-b04a0304ecb1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1683 microversion: 2.1 time: 0.165313 Jul 04 09:27:19.220173 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 469/956] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:19 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:20.093876 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-80b42d73-7d2d-48df-97d1-c4d3fdc68882 req-d7474966-87fb-4430-bdd5-5943f99488e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a75317-e751-4c45-9ec6-3a98521ca1fb", "name": "network-vif-deleted", "tag": "37170a3e-0988-4d6b-886d-ac56bca019eb"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:20.104102 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-80b42d73-7d2d-48df-97d1-c4d3fdc68882 req-d7474966-87fb-4430-bdd5-5943f99488e7 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:20.104724 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-80b42d73-7d2d-48df-97d1-c4d3fdc68882 req-d7474966-87fb-4430-bdd5-5943f99488e7 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:20.117308 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-80b42d73-7d2d-48df-97d1-c4d3fdc68882 req-d7474966-87fb-4430-bdd5-5943f99488e7 service nova] Creating event network-vif-deleted:37170a3e-0988-4d6b-886d-ac56bca019eb for instance d7a75317-e751-4c45-9ec6-3a98521ca1fb on hv-cinder-81914 Jul 04 09:27:20.122536 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-80b42d73-7d2d-48df-97d1-c4d3fdc68882 req-d7474966-87fb-4430-bdd5-5943f99488e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Jul 04 09:27:20.123333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 488/957] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:20.237851 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:20.239277 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:20.246562 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:20.247011 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:20.247791 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:20.248278 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:20.287163 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:20.287763 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:20.288329 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lazy-loading 'fault' on Instance uuid d7a75317-e751-4c45-9ec6-3a98521ca1fb {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:27:20.340233 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:20.347976 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-119936cd-f523-41a8-8c71-cd98040e7f01 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 200 len: 1332 microversion: 2.1 time: 0.114860 Jul 04 09:27:20.348670 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 470/958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:20 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:21.371559 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:21.372714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:21.382202 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:21.382651 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:21.383414 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:21.383846 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:21.397543 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb HTTP/1.1 Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:27:21.399195 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:27:21.400684 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'd7a75317-e751-4c45-9ec6-3a98521ca1fb'} Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:27:21.401484 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:27:21.403088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:21.404631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:27:21.404631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5400fd3e-90e6-4d40-91f1-091660599056 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 404 len: 111 microversion: 2.1 time: 0.037302 Jul 04 09:27:21.404631 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 489/959] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:21 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:27:21.409804 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e214b336-4052-4cfa-9926-a596c53de8a1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '.version_select at 0x7f8e81085430>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:21.429310 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e214b336-4052-4cfa-9926-a596c53de8a1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026358023" status: 202 len: 0 microversion: 2.1 time: 0.023355 Jul 04 09:27:21.429853 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 471/960] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 4 09:27:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026358023 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:27:22.125931 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:22.126590 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:22.133847 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:22.134450 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:22.135221 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:22.135645 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:22.216404 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lazy-loading 'services' on Instance uuid 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:27:22.292718 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-6bfa925b-8229-4451-9f6d-6a9e26732b4c tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments/e551d46c-786b-49f6-98df-ae0ad4e52086" status: 202 len: 0 microversion: 2.1 time: 0.171945 Jul 04 09:27:22.293362 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 490/961] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:27:22 2022] DELETE /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments/e551d46c-786b-49f6-98df-ae0ad4e52086 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:27:22.302776 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-14116158-51a3-4cd2-83e6-51ea942c5572 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:22.303717 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-14116158-51a3-4cd2-83e6-51ea942c5572 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:22.310935 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14116158-51a3-4cd2-83e6-51ea942c5572 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:22.311376 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14116158-51a3-4cd2-83e6-51ea942c5572 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:22.312148 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14116158-51a3-4cd2-83e6-51ea942c5572 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:22.312583 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14116158-51a3-4cd2-83e6-51ea942c5572 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:22.344085 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-14116158-51a3-4cd2-83e6-51ea942c5572 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046233 Jul 04 09:27:22.344680 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 472/962] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:27:22 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:27:23.361954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-11ee4196-e23d-4481-884b-0b13047469d7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:23.363709 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-11ee4196-e23d-4481-884b-0b13047469d7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:23.371677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-11ee4196-e23d-4481-884b-0b13047469d7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:23.372118 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-11ee4196-e23d-4481-884b-0b13047469d7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:23.372880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-11ee4196-e23d-4481-884b-0b13047469d7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:23.373316 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-11ee4196-e23d-4481-884b-0b13047469d7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:23.402651 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-11ee4196-e23d-4481-884b-0b13047469d7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048776 Jul 04 09:27:23.403207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 491/963] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:27:23 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:27:23.462562 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:23.463107 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:23.472983 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:23.473620 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:23.474978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:23.475468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:23.502245 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:27:23.585511 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8a4659d2-dd9b-4936-9d35-9d235f628c7b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 204 len: 0 microversion: 2.1 time: 0.129090 Jul 04 09:27:23.586139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 473/964] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:27:23 2022] DELETE /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:27:23.594688 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:23.595377 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:23.601585 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:23.602097 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:23.602860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:23.603288 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:23.742573 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:23.750733 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2e1999f4-9b06-4a9a-88c0-04ae669189bd tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1681 microversion: 2.1 time: 0.159930 Jul 04 09:27:23.751314 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 492/965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:23 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:27:24.773603 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:24.774440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:24.781954 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:24.782474 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:24.783334 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:24.783846 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:24.928768 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:24.936440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fe5d579f-820b-470e-9868-c26226666aa1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1681 microversion: 2.1 time: 0.169634 Jul 04 09:27:24.937010 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 474/966] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:24 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:25.954328 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:25.954959 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:25.961668 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:25.962181 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:25.962952 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:25.963393 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:26.054139 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:26.061996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e03ab895-ddd8-4647-99f2-f4e9abc746f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 200 len: 1614 microversion: 2.1 time: 0.111693 Jul 04 09:27:26.062594 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 493/967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:25 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:26.136569 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-36db75a1-ba21-4d37-bd94-b73913176d74 req-256c327b-849a-4b82-8e00-072c7f75e65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627", "name": "network-vif-deleted", "tag": "0489cfc9-3b2b-469b-b7ae-e5083571008d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:26.146299 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-36db75a1-ba21-4d37-bd94-b73913176d74 req-256c327b-849a-4b82-8e00-072c7f75e65a service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:26.146966 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-36db75a1-ba21-4d37-bd94-b73913176d74 req-256c327b-849a-4b82-8e00-072c7f75e65a service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:26.159128 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-36db75a1-ba21-4d37-bd94-b73913176d74 req-256c327b-849a-4b82-8e00-072c7f75e65a service nova] Creating event network-vif-deleted:0489cfc9-3b2b-469b-b7ae-e5083571008d for instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 on hv-cinder-81914 Jul 04 09:27:26.164984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-36db75a1-ba21-4d37-bd94-b73913176d74 req-256c327b-849a-4b82-8e00-072c7f75e65a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032141 Jul 04 09:27:26.168898 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 475/968] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:27.079577 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:27.080193 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:27.087588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:27.088183 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:27.088970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:27.089404 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:27.104015 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 HTTP/1.1 Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:27:27.105871 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:27:27.107598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627'} Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:27:27.108561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:27:27.110082 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:27:27.112024 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:27:27.112024 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-5677967d-8433-4d64-9714-8a58f8fa5fe1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 404 len: 111 microversion: 2.1 time: 0.031628 Jul 04 09:27:27.112024 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 494/969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:27 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:27:27.117140 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-959bcb59-0c7d-4e13-b857-ddace005236d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '.version_select at 0x7f8e80f0d5e0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:27.139194 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-959bcb59-0c7d-4e13-b857-ddace005236d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218801307" status: 202 len: 0 microversion: 2.1 time: 0.026330 Jul 04 09:27:27.140098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 476/970] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 4 09:27:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218801307 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:27:27.773458 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-bfe9c7f0-8d82-44f4-96ba-a6fe4ab2ea6f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: .version_select at 0x7f8e80ed2700>, body: {"keypair": {"name": "tempest-keypair-1379194112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlp/534I29e5UW2f/B7uwkj/v+8LPaZ0mSOrIKWx5GhT1ofHmslBeqtlxljC0iPLygLMBwACYSqYKgRInkmYOSY6rodY3l3wzbZukYTA3rC1hOzF0t4ljTcj/gikRPaUg=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:27.787615 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-bfe9c7f0-8d82-44f4-96ba-a6fe4ab2ea6f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:27:27.791516 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-bfe9c7f0-8d82-44f4-96ba-a6fe4ab2ea6f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:27:27.803246 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bfe9c7f0-8d82-44f4-96ba-a6fe4ab2ea6f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [71e62b90-5f96-4f82-b717-eb5fd043a7a0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 09:27:28.812973 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO oslo.messaging._drivers.impl_rabbit [None req-bfe9c7f0-8d82-44f4-96ba-a6fe4ab2ea6f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [71e62b90-5f96-4f82-b717-eb5fd043a7a0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39200. Jul 04 09:27:28.832435 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-bfe9c7f0-8d82-44f4-96ba-a6fe4ab2ea6f tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.063096 Jul 04 09:27:28.833068 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 495/971] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:27:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:30.140457 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-278993485", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "486e3f33-e162-412f-9da2-b680c8148bb8"}], "security_groups": [{"name": "tempest-securitygroup--776881503"}], "key_name": "tempest-keypair-1379194112", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:30.248074 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] validate_networks() for [('486e3f33-e162-412f-9da2-b680c8148bb8', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:27:30.746875 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:27:30.747295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:27:30.747768 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:27:30.748182 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:27:30.748589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:27:30.758528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:30.758913 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:30.759708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:30.760138 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:30.777734 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:27:30.781777 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:27:30.793232 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:27:30.795635 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:27:30.847301 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-93e8a98e-fa74-41ba-b9ba-46e26795ce36 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712081 Jul 04 09:27:30.847944 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 477/972] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:27:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:27:30.858990 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ed9776b7-8dcd-4edd-a743-606b2659c9b5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:30.859711 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ed9776b7-8dcd-4edd-a743-606b2659c9b5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:30.919996 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-ed9776b7-8dcd-4edd-a743-606b2659c9b5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:30.926859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ed9776b7-8dcd-4edd-a743-606b2659c9b5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1241 microversion: 2.1 time: 0.072523 Jul 04 09:27:30.927733 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 496/973] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:30 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:31.944923 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:31.945529 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:31.952754 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:31.953194 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:31.954195 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:31.954879 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:32.031289 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:32.039111 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ab2340f2-560a-46b4-a810-27d3e0e6c30b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1311 microversion: 2.1 time: 0.098677 Jul 04 09:27:32.039744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 478/974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:31 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:33.057558 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:33.058178 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:33.066245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:33.066554 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:33.067673 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:33.068114 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:33.391802 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:33.400934 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-186197c7-6458-481e-abc6-cefa8049f3cb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1366 microversion: 2.1 time: 0.347720 Jul 04 09:27:33.401795 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 497/975] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:33 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:33.593931 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-76a8eb13-30a3-4f5e-a4c4-fb49d63badd5 req-e08c129c-1471-409a-961f-8f86dd2bee39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fdba9c-67f2-4c33-bf44-928c384741b2", "tag": "66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:33.602945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-76a8eb13-30a3-4f5e-a4c4-fb49d63badd5 req-e08c129c-1471-409a-961f-8f86dd2bee39 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:33.603197 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-76a8eb13-30a3-4f5e-a4c4-fb49d63badd5 req-e08c129c-1471-409a-961f-8f86dd2bee39 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:33.623067 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-76a8eb13-30a3-4f5e-a4c4-fb49d63badd5 req-e08c129c-1471-409a-961f-8f86dd2bee39 service nova] Creating event network-changed:66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f for instance a1fdba9c-67f2-4c33-bf44-928c384741b2 on hv-cinder-81914 Jul 04 09:27:33.628012 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-76a8eb13-30a3-4f5e-a4c4-fb49d63badd5 req-e08c129c-1471-409a-961f-8f86dd2bee39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037977 Jul 04 09:27:33.628677 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 479/976] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:27:34.420155 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:34.421080 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:34.429624 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:34.430281 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:34.431136 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:34.431579 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:34.584752 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:34.593518 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-12d2025d-70df-4ac4-8e45-4c27e0039570 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1366 microversion: 2.1 time: 0.179322 Jul 04 09:27:34.594127 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 498/977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:34 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:35.616918 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:35.618373 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:35.628987 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:35.629778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:35.631070 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:35.631758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:35.772645 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:35.780589 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-362086d4-ced5-467d-93f6-cf5cf834e8e0 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1366 microversion: 2.1 time: 0.171841 Jul 04 09:27:35.781139 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 480/978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:35 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:36.798201 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:36.798783 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:36.805763 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:36.806240 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:36.807040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:36.807472 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:36.937610 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:36.945321 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-537fb0f3-bb93-4d4f-9332-d61109c54232 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1366 microversion: 2.1 time: 0.151184 Jul 04 09:27:36.945982 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 499/979] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:36 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:37.955740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-6cd37854-82b4-479b-8230-2d5fc68bbf48 req-c61a8ba3-8986-4053-90cf-e81432eb38e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fdba9c-67f2-4c33-bf44-928c384741b2", "name": "network-vif-plugged", "status": "completed", "tag": "66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:37.964995 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6cd37854-82b4-479b-8230-2d5fc68bbf48 req-c61a8ba3-8986-4053-90cf-e81432eb38e2 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:37.965411 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6cd37854-82b4-479b-8230-2d5fc68bbf48 req-c61a8ba3-8986-4053-90cf-e81432eb38e2 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:37.967928 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:37.969174 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:37.976255 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:37.976701 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:37.977658 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-6cd37854-82b4-479b-8230-2d5fc68bbf48 req-c61a8ba3-8986-4053-90cf-e81432eb38e2 service nova] Creating event network-vif-plugged:66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f for instance a1fdba9c-67f2-4c33-bf44-928c384741b2 on hv-cinder-81914 Jul 04 09:27:37.977805 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:37.978146 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:37.983127 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-6cd37854-82b4-479b-8230-2d5fc68bbf48 req-c61a8ba3-8986-4053-90cf-e81432eb38e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031055 Jul 04 09:27:37.983811 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 481/980] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:38.132023 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:38.143098 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-2acf2515-3725-4355-a79d-0547f39bf0eb tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1366 microversion: 2.1 time: 0.179219 Jul 04 09:27:38.144251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 500/981] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:37 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:39.164859 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:39.165628 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:39.176222 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:39.176895 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:39.178159 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:39.178872 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:39.331110 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:39.341146 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-316e07ce-5ed0-4d3e-a298-f6b8fd9c725a tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1366 microversion: 2.1 time: 0.183747 Jul 04 09:27:39.341770 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 482/982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:39 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:40.362639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:40.363575 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:40.374510 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:40.375247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:40.376544 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:40.377251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:40.522562 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:40.531074 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-53c12cd9-0270-4ce3-a430-2bf4acf96a21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1556 microversion: 2.1 time: 0.174939 Jul 04 09:27:40.531689 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 501/983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:40 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:40.553162 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0c0865ca-d32c-4e91-90ab-24d307a910c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:40.553957 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0c0865ca-d32c-4e91-90ab-24d307a910c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:40.562900 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0865ca-d32c-4e91-90ab-24d307a910c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:40.563453 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0865ca-d32c-4e91-90ab-24d307a910c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:40.564687 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0865ca-d32c-4e91-90ab-24d307a910c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:40.565264 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0865ca-d32c-4e91-90ab-24d307a910c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:40.652596 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0c0865ca-d32c-4e91-90ab-24d307a910c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106114 Jul 04 09:27:40.653221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 483/984] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:27:40 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:41.622817 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-5aa23057-9e3b-4f4d-8d1a-3d4ab77b2a98 req-5c9c2a27-459b-4aca-94ea-3a90e8161f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fdba9c-67f2-4c33-bf44-928c384741b2", "tag": "66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:41.626440 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:41.632922 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-5aa23057-9e3b-4f4d-8d1a-3d4ab77b2a98 req-5c9c2a27-459b-4aca-94ea-3a90e8161f39 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:41.633360 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-5aa23057-9e3b-4f4d-8d1a-3d4ab77b2a98 req-5c9c2a27-459b-4aca-94ea-3a90e8161f39 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:41.645025 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-5aa23057-9e3b-4f4d-8d1a-3d4ab77b2a98 req-5c9c2a27-459b-4aca-94ea-3a90e8161f39 service nova] Creating event network-changed:66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f for instance a1fdba9c-67f2-4c33-bf44-928c384741b2 on hv-cinder-81914 Jul 04 09:27:41.650284 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-5aa23057-9e3b-4f4d-8d1a-3d4ab77b2a98 req-5c9c2a27-459b-4aca-94ea-3a90e8161f39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031315 Jul 04 09:27:41.651372 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 502/985] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:28:17.515591 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:17.516781 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:17.519587 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:17.520450 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:17.526790 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bdf0d250-fad1-4e24-aa96-1e641e026c91 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:17.527584 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bdf0d250-fad1-4e24-aa96-1e641e026c91 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:17.537581 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdf0d250-fad1-4e24-aa96-1e641e026c91 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:17.538130 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdf0d250-fad1-4e24-aa96-1e641e026c91 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:17.538851 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdf0d250-fad1-4e24-aa96-1e641e026c91 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:17.539282 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdf0d250-fad1-4e24-aa96-1e641e026c91 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:17.564420 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bdf0d250-fad1-4e24-aa96-1e641e026c91 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/ips" status: 200 len: 149 microversion: 2.1 time: 0.050598 Jul 04 09:28:17.564980 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 484/986] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:28:17 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:18.911050 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:18.912311 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:18.919038 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f8fc54f1-b629-4df6-b224-7881e2db5388 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8085cd34-6ee0-4867-a717-8a8839cfb90c"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:18.920788 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f8fc54f1-b629-4df6-b224-7881e2db5388 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:18.931761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f8fc54f1-b629-4df6-b224-7881e2db5388 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:18.932250 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f8fc54f1-b629-4df6-b224-7881e2db5388 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:18.933135 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f8fc54f1-b629-4df6-b224-7881e2db5388 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:18.933727 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f8fc54f1-b629-4df6-b224-7881e2db5388 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:19.220606 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f8fc54f1-b629-4df6-b224-7881e2db5388 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310978 Jul 04 09:28:19.221244 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 503/987] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:28:18 2022] POST /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:26.803251 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8085cd34-6ee0-4867-a717-8a8839cfb90c"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:26.804320 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:26.810973 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:26.811409 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:26.812365 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:26.812619 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:26.897618 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Invalid volume: volume 8085cd34-6ee0-4867-a717-8a8839cfb90c is already attached to instances: a1fdba9c-67f2-4c33-bf44-928c384741b2 Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments HTTP/1.1 Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 74 Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:28:26.899440 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {"volumeAttachment": {"volumeId": "8085cd34-6ee0-4867-a717-8a8839cfb90c"}} Jul 04 09:28:26.900974 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Invalid volume: volume 8085cd34-6ee0-4867-a717-8a8839cfb90c is already attached to instances: a1fdba9c-67f2-4c33-bf44-928c384741b2 Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'server_id': 'a1fdba9c-67f2-4c33-bf44-928c384741b2', 'body': {'volumeAttachment': {'volumeId': '8085cd34-6ee0-4867-a717-8a8839cfb90c'}}} Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8085cd34-6ee0-4867-a717-8a8839cfb90c is already attached to instances: a1fdba9c-67f2-4c33-bf44-928c384741b2 Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:28:26.901865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8085cd34-6ee0-4867-a717-8a8839cfb90c is already attached to instances: a1fdba9c-67f2-4c33-bf44-928c384741b2 Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:26.903560 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8085cd34-6ee0-4867-a717-8a8839cfb90c is already attached to instances: a1fdba9c-67f2-4c33-bf44-928c384741b2 Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 400 to user: Invalid volume: volume 8085cd34-6ee0-4867-a717-8a8839cfb90c is already attached to instances: a1fdba9c-67f2-4c33-bf44-928c384741b2 {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a38bb307-ac4a-4f2d-acab-40edf930c492 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102186 Jul 04 09:28:26.904956 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 485/988] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:28:26 2022] POST /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:28:26.965282 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:26.965859 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:26.972514 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:26.972971 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:26.973874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:26.974351 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:27.060163 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.objects.instance [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lazy-loading 'services' on Instance uuid a1fdba9c-67f2-4c33-bf44-928c384741b2 {{(pid=117795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:28:27.143402 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-b6c6bfc7-84be-4168-a1ed-bf1084cfe193 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments/8085cd34-6ee0-4867-a717-8a8839cfb90c" status: 202 len: 0 microversion: 2.1 time: 0.182755 Jul 04 09:28:27.144019 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 504/989] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:28:26 2022] DELETE /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments/8085cd34-6ee0-4867-a717-8a8839cfb90c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:28:27.153965 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-512ff185-6549-4330-83af-2b6fb3f3a6db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:27.155228 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-512ff185-6549-4330-83af-2b6fb3f3a6db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:27.166468 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-512ff185-6549-4330-83af-2b6fb3f3a6db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:27.167095 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-512ff185-6549-4330-83af-2b6fb3f3a6db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:27.168008 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-512ff185-6549-4330-83af-2b6fb3f3a6db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:27.169344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-512ff185-6549-4330-83af-2b6fb3f3a6db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:27.211998 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-512ff185-6549-4330-83af-2b6fb3f3a6db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062271 Jul 04 09:28:27.212491 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 486/990] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:28:27 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:28.228607 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e60ed3e6-b24b-49e8-a8c5-b657d51657db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:28.229751 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e60ed3e6-b24b-49e8-a8c5-b657d51657db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:28.237105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e60ed3e6-b24b-49e8-a8c5-b657d51657db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:28.237725 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e60ed3e6-b24b-49e8-a8c5-b657d51657db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:28.238886 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e60ed3e6-b24b-49e8-a8c5-b657d51657db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:28.239445 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e60ed3e6-b24b-49e8-a8c5-b657d51657db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:28.270993 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e60ed3e6-b24b-49e8-a8c5-b657d51657db tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049331 Jul 04 09:28:28.271531 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 505/991] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:28:28 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:28:28.334295 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:28.334899 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:28.342110 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:28.342557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:28.343312 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:28.343741 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:28.369331 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:28:28.456088 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e6cb9276-4fa8-407f-a2a9-cb762f5a6a23 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 204 len: 0 microversion: 2.1 time: 0.125320 Jul 04 09:28:28.456604 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 487/992] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:28:28 2022] DELETE /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:28:28.465478 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:28.466202 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:28.472305 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:28.472711 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:28.473715 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:28.474173 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:28.624636 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:28.635669 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-59f591f1-626b-46ef-be8a-e5a8f1bca250 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1680 microversion: 2.1 time: 0.174371 Jul 04 09:28:28.636860 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 506/993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:28 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:28:29.657443 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:29.658205 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:29.665268 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:29.665716 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:29.666518 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:29.666945 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:29.799067 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:29.807050 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a4677fe1-0557-4da1-9bfe-10edfdcfb673 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1680 microversion: 2.1 time: 0.153875 Jul 04 09:28:29.807620 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 488/994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:29 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:30.824885 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:30.825511 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:30.834040 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:30.834664 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:30.835542 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:30.835976 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:31.095389 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:31.104205 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-36d9c4a8-cff4-4050-9539-8351cd3b1b85 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 200 len: 1680 microversion: 2.1 time: 0.283985 Jul 04 09:28:31.104748 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 507/995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:30 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 1680 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:31.325641 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-545ad794-dcb4-4141-acc6-2efe389167d6 req-3732825c-4afa-4a5d-8afd-3a7e119047c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fdba9c-67f2-4c33-bf44-928c384741b2", "name": "network-vif-deleted", "tag": "66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:31.335621 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-545ad794-dcb4-4141-acc6-2efe389167d6 req-3732825c-4afa-4a5d-8afd-3a7e119047c3 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:31.336506 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-545ad794-dcb4-4141-acc6-2efe389167d6 req-3732825c-4afa-4a5d-8afd-3a7e119047c3 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:31.350006 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-545ad794-dcb4-4141-acc6-2efe389167d6 req-3732825c-4afa-4a5d-8afd-3a7e119047c3 service nova] Creating event network-vif-deleted:66e0ecb3-4e7a-4ec9-b6f0-0abc270e7e0f for instance a1fdba9c-67f2-4c33-bf44-928c384741b2 on hv-cinder-81914 Jul 04 09:28:31.357115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-545ad794-dcb4-4141-acc6-2efe389167d6 req-3732825c-4afa-4a5d-8afd-3a7e119047c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 Jul 04 09:28:31.364377 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 489/996] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:32.121997 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:32.122608 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:32.129765 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:32.130247 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:32.131621 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:32.131621 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:32.151408 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 HTTP/1.1 Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:28:32.153107 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:28:32.154875 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'a1fdba9c-67f2-4c33-bf44-928c384741b2'} Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:28:32.155882 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:28:32.157454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:28:32.158908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:28:32.158908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-ec8b2cf2-b29b-44cf-bf37-59a6cedd4af7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 404 len: 111 microversion: 2.1 time: 0.036547 Jul 04 09:28:32.158908 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 508/997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:32 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:28:32.164858 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6f489c37-c056-4b67-b086-ec671a67d277 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '.version_select at 0x7f8e81413c10>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:32.184749 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6f489c37-c056-4b67-b086-ec671a67d277 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379194112" status: 202 len: 0 microversion: 2.1 time: 0.024141 Jul 04 09:28:32.185360 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 490/998] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 4 09:28:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379194112 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:28:33.250006 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-4952b7fc-319c-4266-a67b-d61572e25c04 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: .version_select at 0x7f8e80eec5e0>, body: {"keypair": {"name": "tempest-keypair-486064525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ8gJbFi644/Y4tFrfsLhH+ueFLvxuW72QN9JHbgrujaEPcQv2ZMYnHk8xJj9vzY+6oZ7pSyrAedI7i579coPx3gZ++Ozw1owZ6TIGseOr/cRlwPB06QjUZarJOt6rwhA=="}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:33.266379 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-4952b7fc-319c-4266-a67b-d61572e25c04 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:28:33.272013 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.quota [None req-4952b7fc-319c-4266-a67b-d61572e25c04 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'key_pairs'} {{(pid=117795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:28:33.299804 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-4952b7fc-319c-4266-a67b-d61572e25c04 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053641 Jul 04 09:28:33.300581 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 509/999] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 4 09:28:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:34.698098 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1735823723", "imageRef": "3bbe7091-2b0e-4148-8652-01c8ba72f553", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "486e3f33-e162-412f-9da2-b680c8148bb8"}], "security_groups": [{"name": "tempest-securitygroup--721669"}], "key_name": "tempest-keypair-486064525", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:34.810114 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] validate_networks() for [('486e3f33-e162-412f-9da2-b680c8148bb8', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:28:35.206063 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:28:35.206502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:28:35.206978 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:28:35.207409 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:28:35.207822 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:28:35.217121 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:35.217564 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:35.218865 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:35.219155 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:35.235941 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:28:35.239967 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Getting quotas for user 6852ed4b2e53480b9e5719c7575c8eb9 and project 9157e722ff614bc2916f1971cde517ef. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:28:35.251200 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:28:35.253575 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bbe7091-2b0e-4148-8652-01c8ba72f553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:28:35.302115 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8848fcdd-f821-4b9b-9df1-a087e24bbc40 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.609230 Jul 04 09:28:35.302740 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 491/1000] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 4 09:28:34 2022] POST /compute/v2.1/servers => generated 398 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:28:35.313843 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-c6208145-6b92-44e3-9746-d5e2c7b7d869 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:35.314561 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-c6208145-6b92-44e3-9746-d5e2c7b7d869 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:35.372915 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-c6208145-6b92-44e3-9746-d5e2c7b7d869 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:35.380042 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-c6208145-6b92-44e3-9746-d5e2c7b7d869 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1241 microversion: 2.1 time: 0.070585 Jul 04 09:28:35.380633 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 510/1001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:35 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:36.404826 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:36.406492 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:36.416257 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:36.417133 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:36.418308 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:36.418744 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:36.500430 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:36.508955 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b203eba6-7594-42e8-916a-b9add4946ff5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1311 microversion: 2.1 time: 0.112467 Jul 04 09:28:36.509871 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 492/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:36 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:37.527954 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:37.528655 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:37.535548 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:37.535993 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:37.536761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:37.537188 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:37.742086 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:37.750815 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-944b7f2b-a8c5-4228-b185-d52938f92e21 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1363 microversion: 2.1 time: 0.226817 Jul 04 09:28:37.751413 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 511/1003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:37 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:37.887462 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-31cb6e91-32d8-47e1-9f57-080a43959c51 req-ecb2f244-ccdf-4394-89dc-020760704684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52c054b-75bf-490c-9e2d-14b1accf6407", "tag": "c4c21db1-6ed3-4b90-8c20-a8dfe3be278c"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:37.898896 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-31cb6e91-32d8-47e1-9f57-080a43959c51 req-ecb2f244-ccdf-4394-89dc-020760704684 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:37.899331 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-31cb6e91-32d8-47e1-9f57-080a43959c51 req-ecb2f244-ccdf-4394-89dc-020760704684 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:37.915592 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-31cb6e91-32d8-47e1-9f57-080a43959c51 req-ecb2f244-ccdf-4394-89dc-020760704684 service nova] Creating event network-changed:c4c21db1-6ed3-4b90-8c20-a8dfe3be278c for instance c52c054b-75bf-490c-9e2d-14b1accf6407 on hv-cinder-81914 Jul 04 09:28:37.921911 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-31cb6e91-32d8-47e1-9f57-080a43959c51 req-ecb2f244-ccdf-4394-89dc-020760704684 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038134 Jul 04 09:28:37.922901 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 493/1004] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:38.777872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:38.778921 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:38.789338 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:38.789780 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:38.790580 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:38.790999 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:38.937032 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:38.958321 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-dc2725aa-d568-4581-ada9-9f0ea51b5f42 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1363 microversion: 2.1 time: 0.186089 Jul 04 09:28:38.958964 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 512/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:38 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:39.981380 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:39.982072 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:39.988996 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:39.989445 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:39.990344 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:39.990782 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:40.128205 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:40.137552 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0607f4ff-8989-47df-ae18-ca4d98d95a27 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1363 microversion: 2.1 time: 0.160736 Jul 04 09:28:40.138068 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 494/1006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:39 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:41.155828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:41.156443 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:41.163620 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:41.164047 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:41.164828 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:41.165260 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:41.302448 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:41.310864 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-0fb99ed6-9b17-4f24-86ce-608ab04de050 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1363 microversion: 2.1 time: 0.159012 Jul 04 09:28:41.311498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 513/1007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:41 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:42.256743 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-396a0c35-1639-4302-b1df-03d660374507 req-0bfb3817-1d3a-49eb-8b72-6cb71b97850e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52c054b-75bf-490c-9e2d-14b1accf6407", "name": "network-vif-plugged", "status": "completed", "tag": "c4c21db1-6ed3-4b90-8c20-a8dfe3be278c"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:42.267054 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-396a0c35-1639-4302-b1df-03d660374507 req-0bfb3817-1d3a-49eb-8b72-6cb71b97850e service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:42.267512 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-396a0c35-1639-4302-b1df-03d660374507 req-0bfb3817-1d3a-49eb-8b72-6cb71b97850e service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:42.280239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-396a0c35-1639-4302-b1df-03d660374507 req-0bfb3817-1d3a-49eb-8b72-6cb71b97850e service nova] Creating event network-vif-plugged:c4c21db1-6ed3-4b90-8c20-a8dfe3be278c for instance c52c054b-75bf-490c-9e2d-14b1accf6407 on hv-cinder-81914 Jul 04 09:28:42.285107 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-396a0c35-1639-4302-b1df-03d660374507 req-0bfb3817-1d3a-49eb-8b72-6cb71b97850e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032195 Jul 04 09:28:42.285694 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 495/1008] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:42.327872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:42.328470 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:42.334806 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:42.335245 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:42.336142 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:42.336588 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:42.500648 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:42.508421 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-f271270f-bee0-4eb5-8c59-86d0aa062a8d tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1363 microversion: 2.1 time: 0.184267 Jul 04 09:28:42.508958 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 514/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:42 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:43.532168 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:43.533157 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:43.542531 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:43.542972 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:43.543736 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:43.544166 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:43.687219 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:43.695277 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eb5c9618-a6f9-4dc3-8e18-08f744d1ad3b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1363 microversion: 2.1 time: 0.170999 Jul 04 09:28:43.696045 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 496/1010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:43 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:44.714351 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:44.715106 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:44.723598 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:44.724154 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:44.725090 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:44.725623 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:44.871039 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:44.882889 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3781691c-e106-47f3-92c9-6294fea6f870 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1553 microversion: 2.1 time: 0.173212 Jul 04 09:28:44.883492 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 515/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:44 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:44.900360 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f42f9af-8f53-4eab-aa73-b72c741391f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:44.900930 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7f42f9af-8f53-4eab-aa73-b72c741391f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:44.908099 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f42f9af-8f53-4eab-aa73-b72c741391f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:44.908539 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f42f9af-8f53-4eab-aa73-b72c741391f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:44.909330 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f42f9af-8f53-4eab-aa73-b72c741391f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:44.909721 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f42f9af-8f53-4eab-aa73-b72c741391f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:44.993538 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7f42f9af-8f53-4eab-aa73-b72c741391f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097651 Jul 04 09:28:44.994136 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 497/1012] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 4 09:28:44 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:46.220093 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell0:SELECT=6 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:46.306895 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-14fe0610-9f74-4202-93f4-c092a3751c58 req-7bca6eb7-4312-4768-af7f-e10dd327cff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52c054b-75bf-490c-9e2d-14b1accf6407", "tag": "c4c21db1-6ed3-4b90-8c20-a8dfe3be278c"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:46.315207 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-14fe0610-9f74-4202-93f4-c092a3751c58 req-7bca6eb7-4312-4768-af7f-e10dd327cff9 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:46.315658 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-14fe0610-9f74-4202-93f4-c092a3751c58 req-7bca6eb7-4312-4768-af7f-e10dd327cff9 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:46.326872 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-14fe0610-9f74-4202-93f4-c092a3751c58 req-7bca6eb7-4312-4768-af7f-e10dd327cff9 service nova] Creating event network-changed:c4c21db1-6ed3-4b90-8c20-a8dfe3be278c for instance c52c054b-75bf-490c-9e2d-14b1accf6407 on hv-cinder-81914 Jul 04 09:28:46.331963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-14fe0610-9f74-4202-93f4-c092a3751c58 req-7bca6eb7-4312-4768-af7f-e10dd327cff9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116513 Jul 04 09:28:46.332811 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 516/1013] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:29:24.210553 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:24.211328 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:24.212631 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:24.213435 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:24.217653 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-28f9ed1b-8fc3-4504-9a4d-78d65c35c8b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:24.218192 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-28f9ed1b-8fc3-4504-9a4d-78d65c35c8b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:24.226328 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28f9ed1b-8fc3-4504-9a4d-78d65c35c8b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:24.226773 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28f9ed1b-8fc3-4504-9a4d-78d65c35c8b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:24.227528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28f9ed1b-8fc3-4504-9a4d-78d65c35c8b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:24.227971 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28f9ed1b-8fc3-4504-9a4d-78d65c35c8b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:24.253302 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-28f9ed1b-8fc3-4504-9a4d-78d65c35c8b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/ips" status: 200 len: 150 microversion: 2.1 time: 0.043614 Jul 04 09:29:24.253922 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 498/1014] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 4 09:29:24 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:29:25.597835 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:25.598974 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG dbcounter [-] [117795] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:29:25.605159 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-57433c09-214d-4164-a078-78ad219d3e8b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41e23af4-538e-48fb-a061-87e7019626e2"}} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:29:25.607159 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-57433c09-214d-4164-a078-78ad219d3e8b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:25.621517 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-57433c09-214d-4164-a078-78ad219d3e8b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:25.622342 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-57433c09-214d-4164-a078-78ad219d3e8b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:25.623714 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-57433c09-214d-4164-a078-78ad219d3e8b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:25.624480 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-57433c09-214d-4164-a078-78ad219d3e8b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:25.901198 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-57433c09-214d-4164-a078-78ad219d3e8b tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "POST /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305546 Jul 04 09:29:25.901914 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 517/1015] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 4 09:29:25 2022] POST /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:29:33.565566 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:33.566174 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:33.573996 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:33.574454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:33.575220 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:33.575656 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:33.666239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lazy-loading 'services' on Instance uuid c52c054b-75bf-490c-9e2d-14b1accf6407 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:29:33.749499 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-193b30c8-748a-42aa-8545-b29cd0724ca5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments/41e23af4-538e-48fb-a061-87e7019626e2" status: 202 len: 0 microversion: 2.1 time: 0.189750 Jul 04 09:29:33.750279 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 499/1016] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 4 09:29:33 2022] DELETE /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments/41e23af4-538e-48fb-a061-87e7019626e2 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:29:33.761088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-1117e434-6672-490e-adc0-2a0363d496c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:33.762885 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-1117e434-6672-490e-adc0-2a0363d496c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:33.770989 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1117e434-6672-490e-adc0-2a0363d496c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:33.771446 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1117e434-6672-490e-adc0-2a0363d496c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:33.772251 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1117e434-6672-490e-adc0-2a0363d496c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:33.772813 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-1117e434-6672-490e-adc0-2a0363d496c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:33.811374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-1117e434-6672-490e-adc0-2a0363d496c1 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056031 Jul 04 09:29:33.812216 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 518/1017] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:29:33 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:29:34.827800 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be5bdfdd-e70d-4394-b8a2-b83945970269 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:34.829353 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be5bdfdd-e70d-4394-b8a2-b83945970269 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:34.839020 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be5bdfdd-e70d-4394-b8a2-b83945970269 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:34.839473 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be5bdfdd-e70d-4394-b8a2-b83945970269 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:34.840238 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be5bdfdd-e70d-4394-b8a2-b83945970269 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:34.840671 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be5bdfdd-e70d-4394-b8a2-b83945970269 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:34.870221 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be5bdfdd-e70d-4394-b8a2-b83945970269 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049671 Jul 04 09:29:34.870794 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 500/1018] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 4 09:29:34 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:29:34.936357 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:34.936874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:34.943916 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:34.944395 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:34.945485 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:34.945925 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:34.971844 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Going to try to terminate instance {{(pid=117795) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:29:35.057260 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-23926661-81da-4f4b-b153-9435bf01f022 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 204 len: 0 microversion: 2.1 time: 0.124454 Jul 04 09:29:35.058014 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 519/1019] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:29:34 2022] DELETE /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:29:35.066516 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:35.067239 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:35.073856 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:35.074341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:35.075108 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:35.075541 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:35.207354 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:29:35.219274 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f290403b-f10e-4627-b83f-b0e402a460f6 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1678 microversion: 2.1 time: 0.156562 Jul 04 09:29:35.220058 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 501/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:35 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:29:36.242178 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:36.242950 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:36.250874 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:36.251374 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:36.252223 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:36.252699 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:36.392002 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.policy [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117795) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:29:36.399753 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-173bd2c4-dce3-462a-8103-8316bd247171 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1678 microversion: 2.1 time: 0.164582 Jul 04 09:29:36.400333 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 520/1021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:36 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:29:37.417599 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:37.418328 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:37.424708 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:37.425161 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:37.425917 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:37.426394 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:37.645984 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6852ed4b2e53480b9e5719c7575c8eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9157e722ff614bc2916f1971cde517ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:29:37.654298 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a2f34158-f441-4ac9-9279-1467f4f63cdc tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 200 len: 1678 microversion: 2.1 time: 0.241260 Jul 04 09:29:37.654909 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 502/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:37 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:29:38.049848 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [req-8003b0c2-2b01-40ed-9802-8604d2852c6a req-ff20ba81-26ff-471a-9b15-ec70fcdb7713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52c054b-75bf-490c-9e2d-14b1accf6407", "name": "network-vif-deleted", "tag": "c4c21db1-6ed3-4b90-8c20-a8dfe3be278c"}]} {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:29:38.060439 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-8003b0c2-2b01-40ed-9802-8604d2852c6a req-ff20ba81-26ff-471a-9b15-ec70fcdb7713 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:38.061011 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [req-8003b0c2-2b01-40ed-9802-8604d2852c6a req-ff20ba81-26ff-471a-9b15-ec70fcdb7713 service nova] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:38.074012 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.compute.server_external_events [req-8003b0c2-2b01-40ed-9802-8604d2852c6a req-ff20ba81-26ff-471a-9b15-ec70fcdb7713 service nova] Creating event network-vif-deleted:c4c21db1-6ed3-4b90-8c20-a8dfe3be278c for instance c52c054b-75bf-490c-9e2d-14b1accf6407 on hv-cinder-81914 Jul 04 09:29:38.082297 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [req-8003b0c2-2b01-40ed-9802-8604d2852c6a req-ff20ba81-26ff-471a-9b15-ec70fcdb7713 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036376 Jul 04 09:29:38.082880 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 521/1023] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 4 09:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:29:38.671831 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:38.672454 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:38.679396 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:38.680564 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:38.681355 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:38.681795 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:38.695884 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 HTTP/1.1 Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:29:38.697691 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:38.699275 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'c52c054b-75bf-490c-9e2d-14b1accf6407'} Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:38.700134 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:38.701502 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:38.702953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:38.702953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-45c9e6b0-35da-4ba4-88df-d6386a0fe3f7 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 404 len: 111 microversion: 2.1 time: 0.031308 Jul 04 09:29:38.702953 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 503/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:38 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:29:38.709072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-d2ff689e-778c-480e-9097-2cfcc30e49b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '.version_select at 0x7f8e81151940>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:38.729810 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-d2ff689e-778c-480e-9097-2cfcc30e49b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486064525" status: 202 len: 0 microversion: 2.1 time: 0.024903 Jul 04 09:29:38.730428 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 522/1025] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 4 09:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486064525 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:29:40.500357 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:40.500897 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:40.507622 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:40.508079 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:40.509067 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:40.509361 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:40.524283 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 HTTP/1.1 Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:29:40.526167 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.527698 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'c52c054b-75bf-490c-9e2d-14b1accf6407'} Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:40.528779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.531505 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.534047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:40.534047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3e47dc7b-d229-478f-8327-a068b0e1cb16 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 404 len: 111 microversion: 2.1 time: 0.031178 Jul 04 09:29:40.534047 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 504/1026] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:29:40 2022] DELETE /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:29:40.541397 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:40.542165 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: c52c054b-75bf-490c-9e2d-14b1accf6407] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:40.549051 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:40.549503 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:40.550297 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:40.550741 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:40.564498 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 HTTP/1.1 Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:29:40.566145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.567695 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'c52c054b-75bf-490c-9e2d-14b1accf6407'} Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:40.568814 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. Jul 04 09:29:40.570375 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:40.571897 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance c52c054b-75bf-490c-9e2d-14b1accf6407 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:40.571897 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-e0b0d906-446e-4391-996b-ac13db6928f9 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407" status: 404 len: 111 microversion: 2.1 time: 0.033413 Jul 04 09:29:40.571897 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 523/1027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:40 2022] GET /compute/v2.1/servers/c52c054b-75bf-490c-9e2d-14b1accf6407 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:29:41.732100 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:41.732689 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:41.740557 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.741335 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.742252 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.742845 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.758667 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 HTTP/1.1 Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:29:41.760249 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.761834 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'a1fdba9c-67f2-4c33-bf44-928c384741b2'} Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:41.762817 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.764369 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.766528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:41.766528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-997bb513-38a8-4fa7-99fd-d6c647676e81 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 404 len: 111 microversion: 2.1 time: 0.034850 Jul 04 09:29:41.766528 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 505/1028] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:29:41 2022] DELETE /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:29:41.770761 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:41.771380 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: a1fdba9c-67f2-4c33-bf44-928c384741b2] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:41.778586 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.779035 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.779800 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.780234 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.806145 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 HTTP/1.1 Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:29:41.809220 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.810963 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'a1fdba9c-67f2-4c33-bf44-928c384741b2'} Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:41.811960 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. Jul 04 09:29:41.813639 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.815144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance a1fdba9c-67f2-4c33-bf44-928c384741b2 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:41.815144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-69fac05a-c9d8-4ea3-bbab-cd181a107fc5 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2" status: 404 len: 111 microversion: 2.1 time: 0.044667 Jul 04 09:29:41.815144 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 524/1029] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:41 2022] GET /compute/v2.1/servers/a1fdba9c-67f2-4c33-bf44-928c384741b2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:29:41.823330 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:41.823843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:41.830388 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.830927 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.831718 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.832130 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.847172 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb HTTP/1.1 Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:29:41.848778 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.850447 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': 'd7a75317-e751-4c45-9ec6-3a98521ca1fb'} Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:41.851358 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.852758 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.854080 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:41.854080 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2c3bad42-20d9-42c9-8644-5bc5a63d9b87 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 404 len: 111 microversion: 2.1 time: 0.031807 Jul 04 09:29:41.854080 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 506/1030] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:29:41 2022] DELETE /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:29:41.859798 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:41.860411 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: d7a75317-e751-4c45-9ec6-3a98521ca1fb] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:41.867088 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.867535 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.868454 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:41.868907 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:41.884837 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb HTTP/1.1 Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:29:41.886426 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.888072 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': 'd7a75317-e751-4c45-9ec6-3a98521ca1fb'} Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:41.888995 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. Jul 04 09:29:41.890526 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:41.892455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance d7a75317-e751-4c45-9ec6-3a98521ca1fb could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:41.892455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-433a0379-bac6-470e-bf71-6cc559d0e7b3 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb" status: 404 len: 111 microversion: 2.1 time: 0.031977 Jul 04 09:29:41.892455 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 525/1031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:41 2022] GET /compute/v2.1/servers/d7a75317-e751-4c45-9ec6-3a98521ca1fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:29:43.052056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:43.052631 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:43.060484 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:43.060985 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:43.062178 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:43.062636 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:43.077335 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 HTTP/1.1 Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept: application/json Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Connection: close Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Host: 10.222.0.26 Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Role: member,reader Jul 04 09:29:43.078938 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Roles: member,reader Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: method: > Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: exception: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.080574 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: action_args: {'id': '72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627'} Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:43.081664 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.083240 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.084843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:43.084843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eaba7b78-120d-430c-9c84-b2a0b7095852 tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 404 len: 111 microversion: 2.1 time: 0.033011 Jul 04 09:29:43.084843 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 507/1032] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 4 09:29:43 2022] DELETE /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:29:43.089444 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Calling method '>' {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:29:43.090150 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.compute.api [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] [instance: 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627] Fetching instance by UUID {{(pid=117795) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:29:43.096970 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:43.097423 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:43.098233 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:29:43.098666 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG oslo_concurrency.lockutils [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Lock "b4410294-294c-406b-9aa4-054e5a299f2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:29:43.112597 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.wsgi [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] HTTP exception thrown: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Request method failure captured: Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: request: GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 HTTP/1.1 Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept: application/json Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Accept-Encoding: identity Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Connection: close Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Length: 0 Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Content-Type: application/json Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Host: 10.222.0.26 Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Openstack-System-Scope: None Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: User-Agent: python-urllib3/1.26.9 Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Auth-Token: gAAAAABiwrIIdkvERQt2khLvh2eKNdeSJp1w-Zvg_sJ9r2NaOm-3spzquYExwGIwN9_2T0ARFnXkElHNAuLXeRaZL4KO5HkC-HbfYalAKZ9-kDIaGU9ODiVvlrF-fFRICXxnxMlbeqvsB_Mxk2qyeXHljVwxvQgPseoSEQLiCayvtyybU5PKROc Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Id: None Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Domain-Name: None Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Identity-Status: Confirmed Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Is-Admin-Project: True Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Id: default Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Domain-Name: Default Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Project-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Role: member,reader Jul 04 09:29:43.114105 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Roles: member,reader Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9157e722ff614bc2916f1971cde517ef", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9157e722ff614bc2916f1971cde517ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9157e722ff614bc2916f1971cde517ef"}]}] Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Id: 9157e722ff614bc2916f1971cde517ef Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1220508121 Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Id: default Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Domain-Name: Default Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Id: 6852ed4b2e53480b9e5719c7575c8eb9 Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: X-User-Name: tempest-AttachVolumeNegativeTest-1220508121-project Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: method: > Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: exception: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.115778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: action_args: {'id': '72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627'} Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: {{(pid=117795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:29:43.120677 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. Jul 04 09:29:43.122778 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: ERROR nova.api.openstack.wsgi Jul 04 09:29:43.124176 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: DEBUG nova.api.openstack.wsgi [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] Returning 404 to user: Instance 72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 could not be found. {{(pid=117795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:29:43.124176 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO nova.api.openstack.requestlog [None req-3656ff4e-e770-49db-a271-32a37478faaa tempest-AttachVolumeNegativeTest-1220508121 tempest-AttachVolumeNegativeTest-1220508121-project] 10.222.0.26 "GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627" status: 404 len: 111 microversion: 2.1 time: 0.030448 Jul 04 09:29:43.124176 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: [pid: 117795|app: 0|req: 526/1033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 4 09:29:43 2022] GET /compute/v2.1/servers/72b3b1f6-db9d-4d9d-a5e0-4ff130fdc627 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:31:38.560264 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:31:38.560899 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Mon Jul 4 09:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:31:40.358056 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:31:40.359444 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Mon Jul 4 09:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:31:43.377621 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:31:43.378324 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Mon Jul 4 09:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:34:39.182152 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:34:39.182821 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Mon Jul 4 09:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:34:58.572116 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:34:58.572779 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Mon Jul 4 09:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:35:00.371341 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:35:00.372148 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Mon Jul 4 09:35:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:35:03.388076 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:35:03.389196 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Mon Jul 4 09:35:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:35:14.955842 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:35:14.956770 dv-cinder-819149-7-iscsi devstack@n-api.service[117793]: Mon Jul 4 09:35:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:35:20.156366 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:35:20.156883 dv-cinder-819149-7-iscsi devstack@n-api.service[117795]: Mon Jul 4 09:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!